-- Logs begin at Fri 2022-09-02 20:10:02 UTC, end at Fri 2022-09-02 21:43:35 UTC. -- Sep 02 21:13:32.051044 dv-cinder-852209-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 21:13:32.060142 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 21:13:32 2022] *** Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: nodename: dv-cinder-852209-11-iscsi Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: machine: x86_64 Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: clock source: unix Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: pcre jit disabled Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: detected number of CPU cores: 4 Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: current working directory: / Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: detected binary path: /usr/bin/uwsgi-core Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: your processes number limit is 47680 Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: your memory page size is 4096 bytes Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: detected max file descriptor number: 2048 Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: lock engine: pthread robust mutexes Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: thunder lock: enabled Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 21:13:32.062560 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 21:13:32.102131 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: Python main interpreter initialized at 0x55d723c1c9c0 Sep 02 21:13:32.102131 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: python threads support enabled Sep 02 21:13:32.102131 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: your server socket listen backlog is limited to 100 connections Sep 02 21:13:32.102131 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: your mercy for graceful operations on workers is 90 seconds Sep 02 21:13:32.103216 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 21:13:32.103216 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: *** Operational MODE: preforking *** Sep 02 21:13:32.103350 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: *** uWSGI is running in multiple interpreter mode *** Sep 02 21:13:32.103350 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: spawned uWSGI master process (pid: 106469) Sep 02 21:13:32.103672 dv-cinder-852209-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 21:13:32.104142 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: spawned uWSGI worker 1 (pid: 106470, cores: 1) Sep 02 21:13:32.106742 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: spawned uWSGI worker 2 (pid: 106471, cores: 1) Sep 02 21:13:32.106742 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 21:13:32.775263 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 21:13:32.782876 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 21:13:33.874045 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:13:33.874045 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: from cryptography.utils import int_from_bytes Sep 02 21:13:33.874677 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:13:33.874677 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: from cryptography.utils import int_from_bytes Sep 02 21:13:33.877782 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:13:33.877782 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: from cryptography.utils import int_from_bytes Sep 02 21:13:33.878227 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:13:33.878227 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: from cryptography.utils import int_from_bytes Sep 02 21:13:36.420196 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:13:36.420768 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:13:36.421117 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:13:36.421477 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:13:36.421889 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:13:36.421889 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:13:36.422051 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:13:36.422133 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.422285 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:13:36.422432 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.422646 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:13:36.422739 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.422905 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:13:36.423055 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.423299 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.423393 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.423637 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.423791 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.423961 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.424053 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.424279 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.424370 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.424603 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.424707 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.424861 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.424975 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.425174 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.425268 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.425494 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-11-iscsi {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.425582 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.425837 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.425927 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.426118 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.426226 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.426436 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.426527 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.426752 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.426838 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-11-iscsi {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.427320 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.427498 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.427633 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.427726 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.427933 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.428016 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.428255 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.428423 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.428561 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.429568 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.429678 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.429748 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.429846 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.429929 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.430002 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.430572 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.430658 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.430734 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.430812 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.430995 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.431116 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.431347 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.431436 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.431750 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.431839 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.432064 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.432202 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.432377 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.432486 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.432686 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.432784 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-11-iscsi {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.433014 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.433098 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.433330 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.433433 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.433665 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.433766 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-11-iscsi {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.434060 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.434154 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.434394 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.434491 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.434695 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.434800 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.435012 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.435127 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.435346 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.435446 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.435652 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.435750 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.435977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.436074 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.436300 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.436398 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.436619 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.436710 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.436939 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.437026 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.437240 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.437335 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.437549 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.437636 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.437878 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.437969 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.438189 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.438288 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.438492 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.438577 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.438797 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.438898 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.439048 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.439135 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.439354 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.439441 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.439674 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.439759 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.439947 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.440033 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.440260 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.440358 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.440531 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.440621 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.440779 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.440896 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.441094 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.441223 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.441412 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.441516 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.441717 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.441818 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.442053 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.442139 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.442359 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.442450 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.442663 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.442750 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.442969 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.443064 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.443274 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.443362 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.443577 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.443670 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.443882 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.443977 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.444189 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.444275 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.444496 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.444589 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.444802 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.444894 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.445105 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.445198 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.445423 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.445533 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.445791 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.446510 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.446657 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.446807 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.446951 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.447199 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.447296 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.447538 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.447627 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.447848 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.447932 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.448151 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.448244 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.448468 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.448555 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.448787 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.448873 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.449094 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.449239 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.449397 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.449491 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.449700 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.449786 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.450037 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.450146 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.450348 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.450434 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.450653 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.450752 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.450901 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.451034 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.451199 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.451290 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.451501 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.451587 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.451803 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.451898 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.452105 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.452198 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.452411 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.452506 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.452714 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.452809 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.453022 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.453127 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.453311 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.453406 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.453610 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.453709 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.453931 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.454058 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.454237 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.454323 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.454540 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.454630 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.454842 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.454935 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.455142 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.455237 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.455449 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.455572 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.455749 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.455846 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.456046 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.456132 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.456350 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.456456 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.456661 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.456755 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.456961 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.457069 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.457265 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.457361 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.457568 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.457656 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.457963 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.458064 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.458282 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.458379 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.458585 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.458673 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.458888 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.458973 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.459204 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.459304 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.459509 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.459608 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.459807 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.459894 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.460238 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.460358 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.460471 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.460558 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.460798 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.460900 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.461178 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.461272 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.461399 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.461507 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.461711 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.462001 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.462128 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.462247 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.462448 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.462620 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.462773 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.462925 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.463680 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.463824 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.463977 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.464129 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.464264 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.464413 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.464953 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.465108 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.465259 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.465395 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.465550 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.465894 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.465894 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.466059 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.466139 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.466222 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467329 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467329 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467491 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467571 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467571 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467702 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467777 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467845 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.467909 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.467985 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.468051 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.468115 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.468188 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.468188 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.468318 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.468433 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.468714 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.468804 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:13:36.469032 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.469121 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.469344 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.469436 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.469656 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.469754 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.470007 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.470120 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.470320 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.470438 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.470627 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.470781 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.470935 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.471111 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.471255 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.471431 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.471550 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.471754 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.471877 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.472087 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.472174 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.472405 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.472503 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.472724 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.472819 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.473044 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.473133 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.473368 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.473456 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.473692 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.473789 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.474049 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.474138 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.474359 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.474448 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.474677 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.474765 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.474997 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.475085 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.475313 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.475414 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.475633 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.475720 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.475963 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.476050 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.476288 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.476456 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.476592 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.476675 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.476975 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.477109 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.477391 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.477622 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.477776 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.477986 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.478123 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.478292 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.478433 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.478604 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.478773 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.478926 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.479105 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.479237 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.479428 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.479547 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.479751 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.479858 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.480110 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.480196 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.480433 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.480521 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.480755 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.480843 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.481079 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.481165 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.481400 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.481499 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.481706 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.481793 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.482042 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.482143 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.482376 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.482513 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.482765 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.482868 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.483061 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.483181 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.483381 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.483501 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.483723 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.483813 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.484046 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.484143 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.484378 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.484465 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.484690 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.484775 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.485000 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.485140 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.485322 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.485421 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.485641 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.485743 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.485970 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.486082 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.486288 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.486378 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.486603 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.486755 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.486910 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.487057 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.487202 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.487338 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.487512 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.487646 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.487816 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.487950 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.488127 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.488267 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.488435 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.488571 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.488738 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.488872 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.489061 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.489194 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.489370 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.489524 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.489673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.489824 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.490007 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.490106 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.490314 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.490401 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.490620 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.490707 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.490931 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.491024 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.491240 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.491343 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.491551 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.491659 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.491858 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.491946 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.492168 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.492273 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.493058 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.493161 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.493311 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.493513 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.493623 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.493990 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.494080 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.494318 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.494406 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.494619 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.494705 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.494943 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.495032 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.495262 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.495348 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.495576 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.495691 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.495876 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.495963 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.496184 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.496287 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.496491 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.496588 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.496794 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.496893 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.497093 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.497180 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.497400 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.497498 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.497701 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.497796 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.498028 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.498132 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.498331 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.498433 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.498634 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.498721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.499035 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.499137 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.499351 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.499440 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.499667 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.499754 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.499969 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.500075 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.500273 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.500369 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.500577 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.500666 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.500883 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.500970 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.501195 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.501283 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.501599 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.501701 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.501837 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.501929 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.502144 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.502239 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.502474 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.502560 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.502793 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.502893 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.503106 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.503200 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.503414 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.503501 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.503723 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.503819 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.504034 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.504123 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.504345 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.504452 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.504665 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.504766 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.504976 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.505064 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.505293 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.505388 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.505602 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.505702 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.505946 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.506052 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.506257 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.506346 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.506580 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.506670 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.506887 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.506986 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.507199 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.507285 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.507518 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.507614 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.507846 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.507945 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.508159 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.508333 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.509046 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.509288 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.509401 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.509656 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.509744 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.510021 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.510156 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.510336 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.510435 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.510648 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.510755 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.510959 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.511058 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.511276 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.511376 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.511587 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.511684 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.511901 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.512045 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.512209 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.512354 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.512528 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.512673 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.512820 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.512964 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.513137 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.513271 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.513440 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.513578 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.513753 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.513909 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.514105 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.514197 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.514419 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.514505 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.514729 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.514817 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.515037 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.515125 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.515354 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.515450 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.515661 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.515756 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.515969 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.516064 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.516284 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.516394 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.516585 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.516685 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.516887 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.517021 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.517193 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.517290 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.517503 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.517590 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.517854 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.517945 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.518147 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.518249 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.518450 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.518552 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.518759 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.518846 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.519064 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.519153 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.519367 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.519461 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.519667 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.519763 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.519975 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.520063 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.520281 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.520370 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.520589 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.520675 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.520905 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.520993 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.521221 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.521318 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.521519 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.521606 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.521842 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.521944 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.522157 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.522246 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.522460 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.522562 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.522763 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.522851 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.523062 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.523157 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.523363 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.523465 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.523686 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.523781 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.524019 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.524136 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.524458 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.525027 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.525139 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.525385 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.525707 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.525828 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.526048 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.526383 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.526559 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.526701 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.527015 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.527143 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.527327 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.527426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.527642 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.527751 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.527988 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.528078 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.528306 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.528395 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.528618 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.528707 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.528928 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.529021 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.529239 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.529376 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.529549 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.529645 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.529890 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.529983 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.530214 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.530311 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.530520 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.530607 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.530837 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.530954 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.531138 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.531246 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.531440 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.531529 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.531748 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.531844 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.532069 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.532195 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.532385 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.532639 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.532730 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.532971 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.533062 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.533286 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.533374 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.533603 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.533691 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.533948 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.534054 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.534264 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.534368 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.534583 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.534669 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.534984 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.535170 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.535264 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.535482 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.535581 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.535855 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.535955 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.536097 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.536194 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.536399 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.536535 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.536704 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.536851 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.537006 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.537108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.537312 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.537403 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.537612 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.537843 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.537990 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.538091 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.538228 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.538326 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.538529 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.538626 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.538828 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.538916 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.539128 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.539215 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.539461 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.539614 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.539899 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.539999 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.540213 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.540361 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.540515 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.540691 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.540854 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.540948 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.541119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.541262 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.541408 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.541545 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.541696 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.541850 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.542514 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.542625 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.542625 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.542776 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.542859 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.542936 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.543014 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.543092 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.543240 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.543338 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.543569 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.543666 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.543885 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.543979 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.544185 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.544280 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.544492 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.544579 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.544810 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.544903 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.545094 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.545192 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.545395 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.545482 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.545701 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.545790 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.546036 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.546132 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.546338 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.546425 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.546645 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.546743 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.546952 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.547040 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.547267 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.547426 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.547564 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.547717 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.547875 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.548030 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.548184 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.548330 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.548462 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.548608 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.548745 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.548878 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.549008 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.549145 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.549305 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.549473 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.549614 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.549706 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.549921 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.550016 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.550229 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.550329 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.550528 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.550672 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.550922 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.551081 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.551273 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.551424 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.551570 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.551715 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.551849 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.552196 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.552384 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.552475 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.552658 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.552745 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.552964 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.553067 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.553271 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.553366 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.553568 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.553661 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.553909 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.554011 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.554220 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.554309 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.554522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.554609 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.554823 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.554920 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.555643 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.555801 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.555954 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.556194 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.556339 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.556438 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.556661 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.556800 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.556970 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.557057 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.557300 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.557413 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.557605 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.557704 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.557935 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.558042 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.558242 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.558346 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.558541 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.558635 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.558844 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.558930 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.559151 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.559246 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.559448 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.559534 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.559751 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.559850 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.560053 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.560141 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.560355 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.560446 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.560655 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.560796 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.560975 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.561064 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.561282 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.561402 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.561590 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.561708 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.561929 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.562048 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.562237 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.562353 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.562545 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.562691 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.562854 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.562993 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.563161 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.563352 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.563470 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.563659 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.563797 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.563972 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.564110 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.564290 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.564417 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.564601 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.564724 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.564911 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.565031 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.565223 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.565377 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.565527 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.565688 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.565860 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.566074 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.566172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.566386 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.566486 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.566706 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.566841 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.567030 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.567117 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.567349 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.567444 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.567661 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.567780 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.567972 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.568072 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.568278 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.568376 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.568594 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.568698 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.568911 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.569007 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.569208 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.569312 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.569513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.569610 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.569829 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.569927 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.570149 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.570292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.570457 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.570596 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.570847 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.570995 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.571326 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.571482 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.571617 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.571748 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.571886 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.572032 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.572170 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.572306 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.572446 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.572574 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.572744 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.572903 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.573043 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.573180 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.573349 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.573449 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.573653 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.573748 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.574003 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.574084 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.574314 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.574402 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.574617 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.574718 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.574925 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.575021 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.575228 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.575314 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.575536 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.575615 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.575839 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.575935 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.576153 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.576277 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.576466 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.576591 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.576799 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.577034 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.577134 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.577348 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.577450 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.577660 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.577749 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.577998 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.578091 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.578315 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.578412 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.578626 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.578719 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.578928 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.579065 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.579343 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.579431 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.579654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.579749 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.579966 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.580062 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.580276 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.580365 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.580580 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.580674 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.580884 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.581009 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.581193 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.581289 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.581505 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.581619 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.581829 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.581952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.582130 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.582272 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.582430 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.582590 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.582750 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.582910 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.583053 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.583221 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.583371 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.583532 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.583784 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.583881 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.584094 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.584182 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.584395 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.584483 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.584754 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.584849 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.585072 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.585226 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.585391 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.585478 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.585702 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.585799 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.586043 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.586130 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.586880 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.587091 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.587266 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.587458 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.587628 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.587767 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.587858 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.588089 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.588189 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.588406 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.588513 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.588713 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.588802 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.589023 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.589111 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.589321 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.589417 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.589638 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.589727 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.589983 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.590096 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.590291 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.590390 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.590612 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.590698 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.590943 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.591046 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.591274 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.591383 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.591588 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.591677 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.591911 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.591998 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.592224 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.592313 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.592524 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.592610 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.592829 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.592933 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.593133 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.593231 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.593433 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.593528 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.593735 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.593913 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.594082 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.594225 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.594387 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.594543 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.594697 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.594871 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.595006 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.595204 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.595314 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.595515 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.595609 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.595824 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.595911 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.596227 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.596331 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.596451 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.596540 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.596763 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.596884 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.597092 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.597185 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.597403 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.597492 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.597719 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.597862 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.598046 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.598212 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.598356 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.598495 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.598667 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.598794 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.598970 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.599061 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.599270 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.599376 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.599572 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.599661 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.599900 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.599986 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.600202 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.600307 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.600518 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.600605 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.600844 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.600931 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.601152 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.601247 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.601465 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.601553 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.601779 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.601886 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.602228 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.602448 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.602539 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.602619 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.602834 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.602930 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.603184 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.603283 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.603496 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.603593 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.603823 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.603918 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.604122 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.604217 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.604429 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.604567 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.604732 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.604819 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.605035 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.605135 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.605337 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.605431 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.605643 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.605731 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.605970 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.606062 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.606275 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.606362 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.606576 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.606680 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.606894 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.606983 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.607198 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.607344 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.607519 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.607621 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.607824 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.607911 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.608125 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.608225 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.608428 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.608538 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.608734 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.608847 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.609028 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.609117 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.609337 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.609503 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.609646 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.609734 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.609984 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.610072 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.610299 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.610396 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.610612 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.610699 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.610923 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.611011 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.611231 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.611319 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.611538 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.611634 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.611844 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.611931 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.612157 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.612244 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.612472 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.612559 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.612780 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.612883 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.613094 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.613185 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.613406 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.613492 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.613723 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.613850 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.614067 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.614297 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.614397 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.614626 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.614714 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.614941 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.615030 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.615254 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.615351 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.615565 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.615653 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.615881 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.615970 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.616195 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.616282 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.616510 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.616614 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.616823 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.616914 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.617132 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.617370 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.617508 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.618251 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.618343 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.618580 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.618681 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.618900 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.619044 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.619221 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.619381 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.619547 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.619703 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.619867 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.620021 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.620184 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.620339 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.620502 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.620650 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.620823 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.621005 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.621140 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.621373 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.621511 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.621637 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.621845 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.621963 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.622138 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.622276 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.622478 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.622588 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.622802 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.622891 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.623133 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.623222 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.623456 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.623545 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.623777 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.623874 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.624085 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.624172 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.624393 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.624498 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.624704 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.624792 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.625016 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.625103 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.625340 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.625437 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.625656 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.625741 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.625998 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.626088 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.626310 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.626410 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.626628 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.626740 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.626939 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.627026 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.627254 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.627468 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.627557 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.627769 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.627857 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.628102 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.628198 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.628428 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.628517 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.628751 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.628843 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.629065 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.629162 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.629382 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.629470 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.629708 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.629822 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.630039 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.630142 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.630343 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.630577 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.630668 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.630897 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.631000 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.631232 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.631338 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.631554 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.631687 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.631865 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.631965 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.632170 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.632259 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.632486 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.632574 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.632792 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.632889 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.633109 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.633382 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.633505 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.633838 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.633928 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.634160 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.634248 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.634471 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.634558 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.634799 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.634900 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.635110 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.635196 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.635416 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.635502 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.635736 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.635832 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.636046 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.636132 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.636377 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.636588 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.636695 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.636943 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.637033 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.637266 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.637352 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.637573 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.637668 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.637905 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.637995 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.638216 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.638303 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.638519 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.638618 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.638831 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.638959 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.639135 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.639237 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.639458 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.639559 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.639763 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.639852 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.640066 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.640154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.640368 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.640483 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.640678 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.640778 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.640978 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.641075 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.641278 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.641370 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.641586 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.641701 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.641909 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.642007 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.642217 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.642315 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.642517 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.642605 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.642824 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.642913 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.643126 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.643217 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.643434 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.643529 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.643749 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.643837 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.644059 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.644149 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.644362 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.644458 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.644666 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.644752 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.644969 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.645057 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.645272 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.645363 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.645575 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.645670 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.645910 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.646015 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.646220 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.646308 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.646534 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.646699 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.646845 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.646941 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.647184 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.647279 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.647493 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.647590 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.647821 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.648022 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.648131 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.648354 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.648442 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.648671 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.648775 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.649046 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.649234 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.649374 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.649557 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.649852 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.650020 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.650154 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.650350 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.650490 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.650707 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.650872 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.651030 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.651129 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.651405 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.651577 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.651717 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.651923 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.652077 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.652249 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.652337 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.652589 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.652679 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.652913 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.653000 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.653220 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.653309 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.653528 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.653617 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.653857 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.653964 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.654170 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.654258 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.654479 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.654575 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.654787 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.654876 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.655096 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.655198 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.655409 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.655496 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.655725 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.655816 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.656043 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.656145 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.656360 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.656448 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.656671 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.656757 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.656985 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.657090 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.657300 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.657389 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.657616 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.657745 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.657955 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.658271 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.658359 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.658588 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.658676 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.658915 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.659047 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.659260 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.659361 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.659587 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.659685 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.659895 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.660004 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.660242 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.660564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.660667 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.660882 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.660986 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.661196 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.661286 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.661511 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.661597 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.661840 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.661960 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.662168 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.662276 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.662492 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.662580 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.662807 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.662903 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.663120 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.663217 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.663433 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.663764 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.663850 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.664143 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.664419 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.665031 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.665295 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.665439 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.665621 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.665712 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.665958 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.666084 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.666264 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.666379 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.666579 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.666700 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.666893 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.667029 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.667213 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.667346 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.667527 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.667679 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.667836 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.668029 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.668127 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.668367 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.668460 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.668698 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.668794 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.669010 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.669098 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.669311 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.669399 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.669612 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.669699 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.669945 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.670038 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.670297 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.670403 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.670553 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.670642 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.670855 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.670960 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.671233 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.671338 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.671538 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.671627 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.671840 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.671941 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.672147 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.672250 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.672448 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.672552 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.672752 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.672854 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.673056 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.673144 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.673363 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.673473 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.673676 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.673889 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.673979 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.674059 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.674282 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.674376 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.674597 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.674711 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.674903 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.674992 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.675217 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.675313 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.675526 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.675623 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.675837 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.675926 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.676145 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.676232 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.676452 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.676548 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.676764 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.676864 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.677321 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.677415 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.677655 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.677746 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.677992 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.678084 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.678304 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.678404 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.678615 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.678703 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.678925 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.679012 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.679233 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.679347 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.679542 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.679643 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.679868 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.679964 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.680268 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.680409 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.680589 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.680709 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.680927 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.681038 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.681243 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.681341 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.681560 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.681647 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.681900 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.682015 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.682219 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.682324 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.682537 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.682637 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.682870 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.682970 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.683182 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.683272 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.683514 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.683614 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.683833 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.683922 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.684160 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.684255 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.684445 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.684535 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.684753 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.684858 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.685063 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.685169 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.685411 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.685521 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.685693 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.685790 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.686041 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.686157 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.688854 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.689004 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.689004 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.689275 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.689275 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.689482 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.689608 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.689830 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.689968 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.690083 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.690190 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.690294 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.690399 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.690509 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.690625 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.690733 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.690956 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691039 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691118 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691205 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691294 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691414 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691414 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106471) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:13:36.691576 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691576 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691576 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691576 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691576 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.691576 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.692001 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.692001 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.692316 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.693367 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:13:36.693367 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106470) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:13:36.846801 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO dbcounter [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Registered counter for database nova_api Sep 02 21:13:36.847306 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO dbcounter [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Registered counter for database nova_api Sep 02 21:13:36.869561 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_db.sqlalchemy.engines [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:13:36.871179 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_db.sqlalchemy.engines [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:13:36.876386 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writer thread running {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:13:36.878055 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writer thread running {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:13:36.934717 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.context [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65d0b9d2-8f86-4245-a4cb-5092df7bfecb(cell1) {{(pid=106470) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 21:13:36.938598 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_concurrency.lockutils [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:13:36.939090 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_concurrency.lockutils [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:13:36.940670 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_concurrency.lockutils [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:13:36.941409 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_concurrency.lockutils [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:13:36.941881 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_concurrency.lockutils [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:13:36.943541 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.context [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65d0b9d2-8f86-4245-a4cb-5092df7bfecb(cell1) {{(pid=106471) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 21:13:36.943875 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_concurrency.lockutils [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106470) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:13:36.945969 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO dbcounter [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Registered counter for database nova_cell0 Sep 02 21:13:36.947617 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:13:36.948096 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:13:36.949656 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:13:36.950108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO dbcounter [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Registered counter for database nova_cell1 Sep 02 21:13:36.950413 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:13:36.950853 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:13:36.952897 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:13:36.955011 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO dbcounter [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Registered counter for database nova_cell0 Sep 02 21:13:36.958794 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_db.sqlalchemy.engines [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:13:36.959323 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO dbcounter [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Registered counter for database nova_cell1 Sep 02 21:13:36.959691 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_db.sqlalchemy.engines [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:13:36.964928 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writer thread running {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:13:36.966642 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_db.sqlalchemy.engines [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:13:36.968683 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_db.sqlalchemy.engines [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:13:36.975660 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writer thread running {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:13:36.977647 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writer thread running {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:13:37.104230 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writer thread running {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:13:37.114421 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO dbcounter [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Registered counter for database nova_cell0 Sep 02 21:13:37.123999 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO dbcounter [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Registered counter for database nova_cell0 Sep 02 21:13:37.124193 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG oslo_db.sqlalchemy.engines [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106470) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:13:37.128815 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writer thread running {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:13:37.133314 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_db.sqlalchemy.engines [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106471) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:13:37.138499 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writer thread running {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:13:37.570950 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: WARNING keystonemiddleware.auth_token [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:13:37.578608 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: WARNING keystonemiddleware.auth_token [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:13:37.615200 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: WARNING keystonemiddleware.auth_token [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:13:37.623142 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: WARNING keystonemiddleware.auth_token [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:13:37.922537 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: WARNING keystonemiddleware.auth_token [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:13:37.928762 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: WARNING keystonemiddleware.auth_token [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:13:37.934336 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d723c1c9c0 pid: 106471 (default app) Sep 02 21:13:37.936403 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:13:37.937590 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001722 Sep 02 21:13:37.938039 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Fri Sep 2 21:13:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:13:37.969824 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: WARNING keystonemiddleware.auth_token [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:13:37.975966 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: WARNING keystonemiddleware.auth_token [None req-da052a7d-dde1-4796-b02b-4193766931cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:13:37.981952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d723c1c9c0 pid: 106470 (default app) Sep 02 21:15:02.603734 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:02.604755 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 02 21:15:02.605150 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:15:02.621997 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writing DB stats nova_api:SELECT=3 {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:02.623070 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writing DB stats nova_cell0:SELECT=3 {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:02.625060 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writing DB stats nova_cell1:SELECT=3 {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:02.627512 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:03.529657 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-1da257e5-28f1-43fa-a3b6-47567a375118 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:03.566381 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-1da257e5-28f1-43fa-a3b6-47567a375118 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.953851 Sep 02 21:15:03.586662 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1292 bytes} [Fri Sep 2 21:15:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:05.984392 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:05.985382 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-6796dfb5-e23f-4955-ad87-aa5ed0bf98b3 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 02 21:15:05.986915 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:06.475637 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-65e2b0bd-09d2-4ab0-a0f0-01628f8f2500 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "ram": 256, "name": "cirros256", "id": "c1"}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:06.588443 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-65e2b0bd-09d2-4ab0-a0f0-01628f8f2500 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.595730 Sep 02 21:15:06.589083 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:15:06.603371 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_api:SELECT=3 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:06.604541 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_cell0:SELECT=3 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:06.606546 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_cell1:SELECT=3 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:06.607677 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:06.817040 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-39a48f51-c677-490f-9db7-e2ac059679c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:06.962256 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-39a48f51-c677-490f-9db7-e2ac059679c1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.364699 Sep 02 21:15:06.962858 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1336 bytes} [Fri Sep 2 21:15:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:09.397108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-65e2b0bd-09d2-4ab0-a0f0-01628f8f2500 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:09.399674 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-65e2b0bd-09d2-4ab0-a0f0-01628f8f2500 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003049 Sep 02 21:15:09.412074 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:09 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:10.136976 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-c75a361d-c256-4512-9485-575bd65ae20e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 5, "id": "d1"}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:10.240732 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-c75a361d-c256-4512-9485-575bd65ae20e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.832219 Sep 02 21:15:10.249227 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:15:10.254755 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-f3980059-e6c0-4bc7-a620-1c06acd44b19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:10.360972 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-f3980059-e6c0-4bc7-a620-1c06acd44b19 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109637 Sep 02 21:15:10.362238 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1336 bytes} [Fri Sep 2 21:15:10 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:12.775503 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-c75a361d-c256-4512-9485-575bd65ae20e admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:12.776570 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-c75a361d-c256-4512-9485-575bd65ae20e admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 02 21:15:12.776968 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:13.183827 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-a390ac08-165f-4596-9ebf-b772df2fb977 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "ram": 1024, "id": "d2"}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:13.279997 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-a390ac08-165f-4596-9ebf-b772df2fb977 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496651 Sep 02 21:15:13.280551 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:15:13.293235 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-1577723e-ea4e-4a85-a9d8-70cded299a7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:13.414831 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-1577723e-ea4e-4a85-a9d8-70cded299a7b admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125484 Sep 02 21:15:13.415436 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1336 bytes} [Fri Sep 2 21:15:13 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:15.840915 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-a390ac08-165f-4596-9ebf-b772df2fb977 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:15.842034 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-a390ac08-165f-4596-9ebf-b772df2fb977 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 02 21:15:15.842461 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:16.314101 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-1845fc3f-2882-420a-8c0b-a5fa7187543d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:16.394413 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-1845fc3f-2882-420a-8c0b-a5fa7187543d admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.544205 Sep 02 21:15:16.395107 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:15:16.408638 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-7bc12e30-b605-45c9-b372-e7b827a074fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:16.529757 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-7bc12e30-b605-45c9-b372-e7b827a074fc admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124825 Sep 02 21:15:16.530391 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1336 bytes} [Fri Sep 2 21:15:16 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:18.967823 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-1845fc3f-2882-420a-8c0b-a5fa7187543d admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:18.969100 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-1845fc3f-2882-420a-8c0b-a5fa7187543d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001716 Sep 02 21:15:18.969605 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:19.402418 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-68db55cd-922d-4ee0-9c2b-55125e442984 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "vcpus": 4, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "d4"}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:19.490765 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-68db55cd-922d-4ee0-9c2b-55125e442984 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.513993 Sep 02 21:15:19.492341 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:15:19.504259 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-891e8e5c-a0fa-45ba-8cfc-0961829d93dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:19.632211 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-891e8e5c-a0fa-45ba-8cfc-0961829d93dc admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131250 Sep 02 21:15:19.632807 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1336 bytes} [Fri Sep 2 21:15:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:22.066149 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-68db55cd-922d-4ee0-9c2b-55125e442984 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:22.067249 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-68db55cd-922d-4ee0-9c2b-55125e442984 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Sep 02 21:15:22.067655 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:22.533322 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-db648c1a-270a-4d2a-a500-f07680a31284 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:22.566126 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-db648c1a-270a-4d2a-a500-f07680a31284 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.491224 Sep 02 21:15:22.566914 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1292 bytes} [Fri Sep 2 21:15:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:15:25.042475 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-68db55cd-922d-4ee0-9c2b-55125e442984 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:25.043501 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-68db55cd-922d-4ee0-9c2b-55125e442984 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 02 21:15:25.043924 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:25.554124 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-05979937-8afd-4468-8f32-5dd92a34d048 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "id": "1", "ram": 512}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:25.657324 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-05979937-8afd-4468-8f32-5dd92a34d048 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.606465 Sep 02 21:15:25.658121 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:15:25.672133 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-5f5b736d-de3b-4f40-b575-089c64473456 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:25.814762 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-5f5b736d-de3b-4f40-b575-089c64473456 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146360 Sep 02 21:15:25.815373 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1333 bytes} [Fri Sep 2 21:15:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:28.241174 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-05979937-8afd-4468-8f32-5dd92a34d048 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:28.242628 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-05979937-8afd-4468-8f32-5dd92a34d048 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Sep 02 21:15:28.242925 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:28.670781 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-4bd397b1-5d94-412f-8efa-f9fc8b777f9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "id": "2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.small", "disk": 20}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:28.884226 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-4bd397b1-5d94-412f-8efa-f9fc8b777f9d admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.634655 Sep 02 21:15:28.884787 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:15:28.896985 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-fc1e29c1-5ffe-4f0c-8792-5fa963572aa8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:29.163797 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-fc1e29c1-5ffe-4f0c-8792-5fa963572aa8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.270456 Sep 02 21:15:29.164460 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1333 bytes} [Fri Sep 2 21:15:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:31.602875 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-4bd397b1-5d94-412f-8efa-f9fc8b777f9d admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:31.604657 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-4bd397b1-5d94-412f-8efa-f9fc8b777f9d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002176 Sep 02 21:15:31.604946 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:32.115160 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-d2bb83bf-939f-4bee-868c-4e3a3714a28c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "swap": 0, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:32.202575 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-d2bb83bf-939f-4bee-868c-4e3a3714a28c admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.591105 Sep 02 21:15:32.203841 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:31 2022] POST /compute/v2.1/flavors => generated 406 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:15:32.216579 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-1466b780-45ad-4cec-a05b-779aeeec4942 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:32.353190 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-1466b780-45ad-4cec-a05b-779aeeec4942 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140468 Sep 02 21:15:32.354460 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1333 bytes} [Fri Sep 2 21:15:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:34.914084 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-d2bb83bf-939f-4bee-868c-4e3a3714a28c admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:34.915953 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-d2bb83bf-939f-4bee-868c-4e3a3714a28c admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002348 Sep 02 21:15:34.916374 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:15:35.374520 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-f90b9a7f-cf97-46a5-952d-00a5f6a8f4c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "id": "4", "disk": 80, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:35.380881 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:15:35.454895 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-f90b9a7f-cf97-46a5-952d-00a5f6a8f4c6 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.532083 Sep 02 21:15:35.455562 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:15:35.468139 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-a53a8dcd-45a6-41cd-8122-9ff8d4a57559 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:35.559265 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-a53a8dcd-45a6-41cd-8122-9ff8d4a57559 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094712 Sep 02 21:15:35.560411 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1333 bytes} [Fri Sep 2 21:15:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:15:37.998866 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-f90b9a7f-cf97-46a5-952d-00a5f6a8f4c6 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:37.999902 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-f90b9a7f-cf97-46a5-952d-00a5f6a8f4c6 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 02 21:15:38.002172 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:38.496747 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-964c266c-181f-4784-a4b4-a323be4b3158 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:38.667818 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-964c266c-181f-4784-a4b4-a323be4b3158 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.660229 Sep 02 21:15:38.675173 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1283 bytes} [Fri Sep 2 21:15:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:15:38.682157 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-2643247c-ce7c-4b6d-9901-8a8288fe50d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:15:38.790213 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-2643247c-ce7c-4b6d-9901-8a8288fe50d8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112771 Sep 02 21:15:38.791103 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1333 bytes} [Fri Sep 2 21:15:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:15:58.157476 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-964c266c-181f-4784-a4b4-a323be4b3158 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:58.158455 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-964c266c-181f-4784-a4b4-a323be4b3158 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 02 21:15:58.158862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:15:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:15:58.580360 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-f9ab31f0-6505-4847-92a6-9c94b49bf232 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:58.599033 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-f9ab31f0-6505-4847-92a6-9c94b49bf232 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.432998 Sep 02 21:15:58.599654 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1292 bytes} [Fri Sep 2 21:15:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:15:59.673559 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-964c266c-181f-4784-a4b4-a323be4b3158 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:15:59.674597 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-964c266c-181f-4784-a4b4-a323be4b3158 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 02 21:15:59.674998 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:15:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:00.222455 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-990ad67c-4b65-4e06-9178-c80335191a9e admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:00.229140 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.wsgi [None req-990ad67c-4b65-4e06-9178-c80335191a9e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-990ad67c-4b65-4e06-9178-c80335191a9e admin admin] Request method failure captured: Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Accept: application/json Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Accept-Encoding: gzip, deflate Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Connection: keep-alive Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Content-Length: 0 Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Host: 10.222.0.79 Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Openstack-Api-Version: compute 2.92 Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Openstack-System-Scope: None Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: User-Agent: python-novaclient Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Auth-Token: gAAAAABjEnKPowwLryL9mbVyJtpqz5g-4tO9klE1RvkSqU0rE7GYIho-eX3CZQQw5COn07pUkJH9FJzqnKVW05-a3JbIzWDB1sZ0BWyVIY13DeDEPlpTSmZr-a9psoJ0ia0011I-WmCooN1RCSqtfFkIDYQsUkIkwHHMMHyT2IY7zEK6AICrHjQ Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Domain-Id: None Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Domain-Name: None Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Identity-Status: Confirmed Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Is-Admin-Project: True Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Domain-Id: default Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Domain-Name: Default Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Name: admin Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Role: reader,admin,member Sep 02 21:16:00.235292 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Roles: reader,admin,member Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}] Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant: admin Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant-Name: admin Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User: admin Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Domain-Id: default Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Domain-Name: Default Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Id: ce385e879bed47f191e967e0c64d0d17 Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Name: admin Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: method: > Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: exception: Flavor 42 could not be found. Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: action_args: {'id': '42'} Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:16:00.237119 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:00.238076 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.239564 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-990ad67c-4b65-4e06-9178-c80335191a9e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:16:00.241489 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-990ad67c-4b65-4e06-9178-c80335191a9e admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.421383 Sep 02 21:16:00.241489 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Fri Sep 2 21:15:59 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:00.246278 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-eab9afde-6a3a-4ffa-b654-a02a954ce037 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:00.253320 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:16:00.289914 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-eab9afde-6a3a-4ffa-b654-a02a954ce037 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.048158 Sep 02 21:16:00.290604 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Sep 2 21:16:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:16:00.301328 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-ec9c887f-dbd6-4db4-90da-8806f271e0c5 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:00.331485 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-ec9c887f-dbd6-4db4-90da-8806f271e0c5 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.034378 Sep 02 21:16:00.332056 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Sep 2 21:16:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:16:00.343379 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-6dbae0ce-f4ff-490f-8dee-37280fe8007f admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:00.350748 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.wsgi [None req-6dbae0ce-f4ff-490f-8dee-37280fe8007f admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-6dbae0ce-f4ff-490f-8dee-37280fe8007f admin admin] Request method failure captured: Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Accept: application/json Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Accept-Encoding: gzip, deflate Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Connection: keep-alive Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Content-Length: 0 Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Host: 10.222.0.79 Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Openstack-Api-Version: compute 2.92 Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Openstack-System-Scope: None Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: User-Agent: python-novaclient Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Auth-Token: gAAAAABjEnKPowwLryL9mbVyJtpqz5g-4tO9klE1RvkSqU0rE7GYIho-eX3CZQQw5COn07pUkJH9FJzqnKVW05-a3JbIzWDB1sZ0BWyVIY13DeDEPlpTSmZr-a9psoJ0ia0011I-WmCooN1RCSqtfFkIDYQsUkIkwHHMMHyT2IY7zEK6AICrHjQ Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Domain-Id: None Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Domain-Name: None Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Identity-Status: Confirmed Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Is-Admin-Project: True Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Domain-Id: default Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Domain-Name: Default Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Name: admin Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Role: reader,admin,member Sep 02 21:16:00.354172 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Roles: reader,admin,member Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}] Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant: admin Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant-Name: admin Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User: admin Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Domain-Id: default Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Domain-Name: Default Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Id: ce385e879bed47f191e967e0c64d0d17 Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Name: admin Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: method: > Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: exception: Flavor 42 could not be found. Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: action_args: {'id': '42'} Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:16:00.361426 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:00.362522 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:00.363654 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-6dbae0ce-f4ff-490f-8dee-37280fe8007f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:16:00.364663 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-6dbae0ce-f4ff-490f-8dee-37280fe8007f admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.016435 Sep 02 21:16:00.364663 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Fri Sep 2 21:16:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:01.459418 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-ec9c887f-dbd6-4db4-90da-8806f271e0c5 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:01.460451 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-ec9c887f-dbd6-4db4-90da-8806f271e0c5 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001624 Sep 02 21:16:01.460854 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:16:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:02.006719 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-1e06fad8-91b4-4a03-9a2b-f0b372ee7195 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:02.012798 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.wsgi [None req-1e06fad8-91b4-4a03-9a2b-f0b372ee7195 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-1e06fad8-91b4-4a03-9a2b-f0b372ee7195 admin admin] Request method failure captured: Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Accept: application/json Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Accept-Encoding: gzip, deflate Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Connection: keep-alive Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Content-Length: 0 Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Host: 10.222.0.79 Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Openstack-Api-Version: compute 2.92 Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Openstack-System-Scope: None Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: User-Agent: python-novaclient Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Auth-Token: gAAAAABjEnKRTNRarI9-VK8YtDAgt1VZPrzOZtAZOsrrZ5Gr7SdDV7JYNDVWKfOGWC7BzNpHcZ5zo1n50V3mvwyAE6ZZQOdZSic3xcoXU9Co8xcTNQH-KNrqHQVktzFV3HsIvyV5bX9H3DQX8xxFZiPwlPZ2elBKLhkk-0YNk5iEfQgWWS6JL7I Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Domain-Id: None Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Domain-Name: None Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Identity-Status: Confirmed Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Is-Admin-Project: True Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Domain-Id: default Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Domain-Name: Default Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Name: admin Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Role: reader,admin,member Sep 02 21:16:02.014385 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Roles: reader,admin,member Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}] Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant: admin Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant-Name: admin Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User: admin Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Domain-Id: default Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Domain-Name: Default Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Id: ce385e879bed47f191e967e0c64d0d17 Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Name: admin Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: method: > Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: exception: Flavor 84 could not be found. Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: action_args: {'id': '84'} Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:16:02.015977 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:02.016949 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.018410 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-1e06fad8-91b4-4a03-9a2b-f0b372ee7195 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:16:02.019817 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-1e06fad8-91b4-4a03-9a2b-f0b372ee7195 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.415304 Sep 02 21:16:02.019817 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Fri Sep 2 21:16:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:02.026567 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-bc019972-5505-43ad-aa58-61a2e0733832 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:02.042186 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-bc019972-5505-43ad-aa58-61a2e0733832 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019081 Sep 02 21:16:02.042749 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Sep 2 21:16:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:16:02.053120 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-c678b1e3-3ac9-4be3-9045-5f6b2563661b admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:02.068632 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-c678b1e3-3ac9-4be3-9045-5f6b2563661b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019641 Sep 02 21:16:02.074700 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Sep 2 21:16:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:16:02.082752 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-17766a13-9181-4eed-992d-49f8ca6f6768 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:02.089450 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.wsgi [None req-17766a13-9181-4eed-992d-49f8ca6f6768 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-17766a13-9181-4eed-992d-49f8ca6f6768 admin admin] Request method failure captured: Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Accept: application/json Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Accept-Encoding: gzip, deflate Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Connection: keep-alive Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Content-Length: 0 Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Host: 10.222.0.79 Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Openstack-Api-Version: compute 2.92 Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Openstack-System-Scope: None Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: User-Agent: python-novaclient Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Auth-Token: gAAAAABjEnKRTNRarI9-VK8YtDAgt1VZPrzOZtAZOsrrZ5Gr7SdDV7JYNDVWKfOGWC7BzNpHcZ5zo1n50V3mvwyAE6ZZQOdZSic3xcoXU9Co8xcTNQH-KNrqHQVktzFV3HsIvyV5bX9H3DQX8xxFZiPwlPZ2elBKLhkk-0YNk5iEfQgWWS6JL7I Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Domain-Id: None Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Domain-Name: None Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Identity-Status: Confirmed Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Is-Admin-Project: True Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Domain-Id: default Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Domain-Name: Default Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Name: admin Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Role: reader,admin,member Sep 02 21:16:02.091154 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Roles: reader,admin,member Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}] Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant: admin Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant-Name: admin Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User: admin Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Domain-Id: default Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Domain-Name: Default Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Id: ce385e879bed47f191e967e0c64d0d17 Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Name: admin Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: method: > Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: exception: Flavor 84 could not be found. Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: action_args: {'id': '84'} Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:16:02.092721 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:02.093952 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:02.095371 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-17766a13-9181-4eed-992d-49f8ca6f6768 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:16:02.096604 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-17766a13-9181-4eed-992d-49f8ca6f6768 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.013430 Sep 02 21:16:02.096604 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Fri Sep 2 21:16:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 02 21:16:03.090514 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-c678b1e3-3ac9-4be3-9045-5f6b2563661b admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:03.091549 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-c678b1e3-3ac9-4be3-9045-5f6b2563661b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Sep 02 21:16:03.091940 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:16:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:03.633703 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-43bcabbc-875c-4bcc-99bf-d737b81fbee4 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:03.639598 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.wsgi [None req-43bcabbc-875c-4bcc-99bf-d737b81fbee4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-43bcabbc-875c-4bcc-99bf-d737b81fbee4 admin admin] Request method failure captured: Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Accept: application/json Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Accept-Encoding: gzip, deflate Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Connection: keep-alive Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Content-Length: 0 Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Host: 10.222.0.79 Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Openstack-Api-Version: compute 2.92 Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Openstack-System-Scope: None Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: User-Agent: python-novaclient Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Auth-Token: gAAAAABjEnKSyxvQJalA_oDTctp4U3lm90L8jT9xEdfafBNLJSqfwxZeME7qMMikcskAAHiUYdza7mUJMzH22ZFVhpXxOWxR0xnQlK-VeSKwzdYiEDgzmzu-nIlFGfK4N6j_wlMCIImtUDHi_2vqOaA67aQytaZZnanj9tr90UW3a4rd3Fzp0AQ Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Domain-Id: None Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Domain-Name: None Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Identity-Status: Confirmed Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Is-Admin-Project: True Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Domain-Id: default Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Domain-Name: Default Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Project-Name: admin Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Role: reader,admin,member Sep 02 21:16:03.641108 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Roles: reader,admin,member Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}] Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant: admin Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-Tenant-Name: admin Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User: admin Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Domain-Id: default Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Domain-Name: Default Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Id: ce385e879bed47f191e967e0c64d0d17 Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: X-User-Name: admin Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: method: > Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: exception: Flavor 451 could not be found. Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: action_args: {'id': '451'} Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:16:03.642810 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:03.643934 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.645291 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-43bcabbc-875c-4bcc-99bf-d737b81fbee4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106470) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:16:03.646544 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-43bcabbc-875c-4bcc-99bf-d737b81fbee4 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.414577 Sep 02 21:16:03.646544 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Sep 2 21:16:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:03.654851 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-b2a9cc68-b82c-4104-b8ea-c245de600dee admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:03.670124 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-b2a9cc68-b82c-4104-b8ea-c245de600dee admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018918 Sep 02 21:16:03.670667 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Sep 2 21:16:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:16:03.681992 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:03.697276 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019849 Sep 02 21:16:03.697855 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Fri Sep 2 21:16:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:16:03.713087 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-f56cb171-b417-4ac6-ad1b-aaacb9eee8b7 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:03.719272 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.wsgi [None req-f56cb171-b417-4ac6-ad1b-aaacb9eee8b7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-f56cb171-b417-4ac6-ad1b-aaacb9eee8b7 admin admin] Request method failure captured: Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Accept: application/json Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Accept-Encoding: gzip, deflate Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Connection: keep-alive Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Content-Length: 0 Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Host: 10.222.0.79 Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Openstack-Api-Version: compute 2.92 Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Openstack-System-Scope: None Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: User-Agent: python-novaclient Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Auth-Token: gAAAAABjEnKSyxvQJalA_oDTctp4U3lm90L8jT9xEdfafBNLJSqfwxZeME7qMMikcskAAHiUYdza7mUJMzH22ZFVhpXxOWxR0xnQlK-VeSKwzdYiEDgzmzu-nIlFGfK4N6j_wlMCIImtUDHi_2vqOaA67aQytaZZnanj9tr90UW3a4rd3Fzp0AQ Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Domain-Id: None Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Domain-Name: None Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Identity-Status: Confirmed Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Is-Admin-Project: True Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Openstack-Nova-Api-Version: 2.92 Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Domain-Id: default Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Domain-Name: Default Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Project-Name: admin Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Role: reader,admin,member Sep 02 21:16:03.720862 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Roles: reader,admin,member Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/c04c8d4bc7dc450a92b56e01849b9dc9"}]}] Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant: admin Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant-Id: c04c8d4bc7dc450a92b56e01849b9dc9 Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-Tenant-Name: admin Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User: admin Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Domain-Id: default Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Domain-Name: Default Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Id: ce385e879bed47f191e967e0c64d0d17 Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: X-User-Name: admin Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: method: > Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: exception: Flavor 451 could not be found. Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: action_args: {'id': '451'} Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:16:03.722673 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:03.723513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: ERROR nova.api.openstack.wsgi Sep 02 21:16:03.725513 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-f56cb171-b417-4ac6-ad1b-aaacb9eee8b7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106471) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:16:03.726825 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-f56cb171-b417-4ac6-ad1b-aaacb9eee8b7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013838 Sep 02 21:16:03.726825 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Sep 2 21:16:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 21:16:04.706667 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:04.707699 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 02 21:16:04.708100 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:16:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:05.247913 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-72d58e8c-c9da-449e-811c-e708a5803117 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:05.347394 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-72d58e8c-c9da-449e-811c-e708a5803117 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.494998 Sep 02 21:16:05.347947 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Fri Sep 2 21:16:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:16:06.332622 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:06.334318 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 02 21:16:06.334875 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:16:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:06.879392 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-2c3b8b4d-a96e-4da9-883a-5fa2c27fc957 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:06.963830 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-2c3b8b4d-a96e-4da9-883a-5fa2c27fc957 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.490281 Sep 02 21:16:06.964297 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Fri Sep 2 21:16:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:16:07.949793 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:07.951031 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001678 Sep 02 21:16:07.951426 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:16:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:08.488201 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-e68f3448-e73e-4c97-a8a0-408d17e4cd23 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:08.564679 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-e68f3448-e73e-4c97-a8a0-408d17e4cd23 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.472642 Sep 02 21:16:08.565064 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Fri Sep 2 21:16:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:16:09.563369 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:09.564393 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 02 21:16:09.564829 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:16:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:10.110040 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-3bf2c1ac-35a2-4c3b-87ad-bc88ab6fa8c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:16:10.187171 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-3bf2c1ac-35a2-4c3b-87ad-bc88ab6fa8c6 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.482783 Sep 02 21:16:10.187747 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Fri Sep 2 21:16:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:16:11.191938 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:11.193134 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 02 21:16:11.193543 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:16:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:16:11.720393 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-1f9dc1d3-8375-4e8c-9eda-8022837e56ab admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:16:11.742602 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-1f9dc1d3-8375-4e8c-9eda-8022837e56ab admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.411961 Sep 02 21:16:11.743142 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Fri Sep 2 21:16:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:06.777985 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:06.779005 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-eb2155b0-f26b-418b-97cb-2dc0ccb678be admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 02 21:17:06.779411 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 931 bytes} [Fri Sep 2 21:17:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:17:06.790616 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:07.194475 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-27b642b0-2b9c-4b5d-81a3-17b776f3ed99 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:07.216139 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-27b642b0-2b9c-4b5d-81a3-17b776f3ed99 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.430146 Sep 02 21:17:07.216583 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1292 bytes} [Fri Sep 2 21:17:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:17:07.241048 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-68717965-2ab2-4b6c-ad61-36e783d387f8 admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:07.244583 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG dbcounter [-] [106470] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106470) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:17:07.249639 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-68717965-2ab2-4b6c-ad61-36e783d387f8 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013447 Sep 02 21:17:07.250235 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1283 bytes} [Fri Sep 2 21:17:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:07.262801 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-570d8b58-4402-46e4-957f-0801af6efc03 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:07.270732 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-570d8b58-4402-46e4-957f-0801af6efc03 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011580 Sep 02 21:17:07.271268 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1286 bytes} [Fri Sep 2 21:17:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:17:07.282995 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:07.296573 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017182 Sep 02 21:17:07.297152 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1286 bytes} [Fri Sep 2 21:17:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:17:07.309933 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-b5711908-c32f-4e93-9243-864bfb18fc82 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:17:07.318791 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-b5711908-c32f-4e93-9243-864bfb18fc82 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012539 Sep 02 21:17:07.331266 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1283 bytes} [Fri Sep 2 21:17:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:20:27.033876 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:20:27.035057 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Sep 02 21:20:27.035554 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 34/69] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:20:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:20:27.181899 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_api:SELECT=6 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:27.382635 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-3a6d0097-d1ac-44fa-8190-bc030a7e9b86 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:20:27.388781 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3a6d0097-d1ac-44fa-8190-bc030a7e9b86 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:20:27.389596 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3a6d0097-d1ac-44fa-8190-bc030a7e9b86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:20:27.390369 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3a6d0097-d1ac-44fa-8190-bc030a7e9b86 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:20:27.391613 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3a6d0097-d1ac-44fa-8190-bc030a7e9b86 admin admin] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:20:27.392381 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3a6d0097-d1ac-44fa-8190-bc030a7e9b86 admin admin] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:20:27.393341 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3a6d0097-d1ac-44fa-8190-bc030a7e9b86 admin admin] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:20:27.460199 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-3a6d0097-d1ac-44fa-8190-bc030a7e9b86 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.279311 Sep 02 21:20:27.461193 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 36/70] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Sep 2 21:20:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:20:28.377741 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:20:28.378807 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Sep 02 21:20:28.379225 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:20:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:20:28.584045 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-0787590f-2e84-48b9-b4cf-0009288f05f2 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:20:28.587602 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-0787590f-2e84-48b9-b4cf-0009288f05f2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:20:28.588111 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-0787590f-2e84-48b9-b4cf-0009288f05f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:20:28.588548 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-0787590f-2e84-48b9-b4cf-0009288f05f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:20:28.589280 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-0787590f-2e84-48b9-b4cf-0009288f05f2 admin admin] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:20:28.589728 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-0787590f-2e84-48b9-b4cf-0009288f05f2 admin admin] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:20:28.590247 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-0787590f-2e84-48b9-b4cf-0009288f05f2 admin admin] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:20:28.611444 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-0787590f-2e84-48b9-b4cf-0009288f05f2 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.085510 Sep 02 21:20:28.612041 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 37/72] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Sep 2 21:20:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:20:39.921160 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:20:39.922591 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001957 Sep 02 21:20:39.923384 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 36/73] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:20:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:20:40.075570 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_cell0:SELECT=4 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:40.076527 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_cell1:SELECT=4 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:40.077160 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG dbcounter [-] [106471] Writing DB stats nova_api:SELECT=8 {{(pid=106471) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:20:40.146770 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-3f297471-58ef-42cf-aa50-b0c32acc1e0b admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:20:40.150899 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3f297471-58ef-42cf-aa50-b0c32acc1e0b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:20:40.151413 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3f297471-58ef-42cf-aa50-b0c32acc1e0b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:20:40.151850 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3f297471-58ef-42cf-aa50-b0c32acc1e0b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:20:40.152615 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3f297471-58ef-42cf-aa50-b0c32acc1e0b admin admin] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:20:40.153070 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3f297471-58ef-42cf-aa50-b0c32acc1e0b admin admin] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:20:40.153489 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-3f297471-58ef-42cf-aa50-b0c32acc1e0b admin admin] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:20:40.187217 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-3f297471-58ef-42cf-aa50-b0c32acc1e0b admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.116291 Sep 02 21:20:40.187925 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 38/74] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Sep 2 21:20:40 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:20:41.083513 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: DEBUG nova.api.openstack.wsgi [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] Calling method '>' {{(pid=106470) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:20:41.084911 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: INFO nova.api.openstack.requestlog [None req-e3919b7a-7c10-4b14-8ab3-983429f43b4d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Sep 02 21:20:41.085462 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: [pid: 106470|app: 0|req: 37/75] 10.222.0.79 () {56 vars in 1074 bytes} [Fri Sep 2 21:20:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:20:41.291634 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG nova.api.openstack.wsgi [None req-209910b7-512b-4d57-bdd6-2dda8ba59821 admin admin] Calling method '>' {{(pid=106471) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:20:41.293546 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-209910b7-512b-4d57-bdd6-2dda8ba59821 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:20:41.297013 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-209910b7-512b-4d57-bdd6-2dda8ba59821 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:20:41.297013 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-209910b7-512b-4d57-bdd6-2dda8ba59821 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:20:41.297013 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-209910b7-512b-4d57-bdd6-2dda8ba59821 admin admin] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:20:41.297013 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-209910b7-512b-4d57-bdd6-2dda8ba59821 admin admin] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:20:41.297412 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: DEBUG oslo_concurrency.lockutils [None req-209910b7-512b-4d57-bdd6-2dda8ba59821 admin admin] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106471) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:20:41.319240 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: INFO nova.api.openstack.requestlog [None req-209910b7-512b-4d57-bdd6-2dda8ba59821 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.088037 Sep 02 21:20:41.326155 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: [pid: 106471|app: 0|req: 39/76] 10.222.0.79 () {60 vars in 1193 bytes} [Fri Sep 2 21:20:41 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:21:41.658913 dv-cinder-852209-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 02 21:21:41.660592 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: Fri Sep 2 21:21:41 2022 - graceful shutdown triggered... Sep 02 21:21:41.661190 dv-cinder-852209-11-iscsi devstack@n-api.service[106470]: Gracefully killing worker 1 (pid: 106470)... Sep 02 21:21:41.661855 dv-cinder-852209-11-iscsi devstack@n-api.service[106471]: Gracefully killing worker 2 (pid: 106471)... Sep 02 21:21:42.661953 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: worker 1 buried after 1 seconds Sep 02 21:21:42.662462 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: worker 2 buried after 1 seconds Sep 02 21:21:42.662462 dv-cinder-852209-11-iscsi devstack@n-api.service[106469]: goodbye to uWSGI. Sep 02 21:21:42.663797 dv-cinder-852209-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 02 21:21:42.664507 dv-cinder-852209-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 02 21:21:42.668014 dv-cinder-852209-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 21:21:42.684189 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 2 21:21:42 2022] *** Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: nodename: dv-cinder-852209-11-iscsi Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: machine: x86_64 Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: clock source: unix Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: pcre jit disabled Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: detected number of CPU cores: 4 Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: current working directory: / Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: detected binary path: /usr/bin/uwsgi-core Sep 02 21:21:42.690606 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: your processes number limit is 47680 Sep 02 21:21:42.691953 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: your memory page size is 4096 bytes Sep 02 21:21:42.691953 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: detected max file descriptor number: 2048 Sep 02 21:21:42.691953 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: lock engine: pthread robust mutexes Sep 02 21:21:42.691953 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: thunder lock: enabled Sep 02 21:21:42.691953 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 21:21:42.691953 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 02 21:21:42.760159 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: Python main interpreter initialized at 0x5578a4b9d9c0 Sep 02 21:21:42.760159 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: python threads support enabled Sep 02 21:21:42.760159 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: your server socket listen backlog is limited to 100 connections Sep 02 21:21:42.760159 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: your mercy for graceful operations on workers is 90 seconds Sep 02 21:21:42.760831 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 21:21:42.760974 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: *** Operational MODE: preforking *** Sep 02 21:21:42.761415 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: *** uWSGI is running in multiple interpreter mode *** Sep 02 21:21:42.761415 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: spawned uWSGI master process (pid: 121493) Sep 02 21:21:42.761702 dv-cinder-852209-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 21:21:42.762765 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: spawned uWSGI worker 1 (pid: 121512, cores: 1) Sep 02 21:21:42.763579 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: spawned uWSGI worker 2 (pid: 121513, cores: 1) Sep 02 21:21:42.764063 dv-cinder-852209-11-iscsi devstack@n-api.service[121493]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 21:21:43.601451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 21:21:43.641940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 02 21:21:45.286635 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:21:45.286635 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: from cryptography.utils import int_from_bytes Sep 02 21:21:45.287691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:21:45.287691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: from cryptography.utils import int_from_bytes Sep 02 21:21:45.352807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:21:45.352807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: from cryptography.utils import int_from_bytes Sep 02 21:21:45.353780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 21:21:45.353780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: from cryptography.utils import int_from_bytes Sep 02 21:21:49.190032 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:21:49.191077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:21:49.191077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:21:49.191370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:21:49.191528 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:21:49.191898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.192254 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.192594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.193010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.193352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.193673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.194104 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.194434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.194768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.195028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.195354 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.195859 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-11-iscsi {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.196307 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.196695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.197082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.197425 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.197725 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.198063 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.198394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.198898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.199949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.200536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.201134 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.201712 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.202285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.203254 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.203852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.204337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.204724 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.205173 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.205720 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-11-iscsi {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.206106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.206740 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.207139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.207668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.208025 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.208770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.208977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.209321 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.209759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.210253 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.210637 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.211147 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.211483 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.211799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.212118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.212438 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.212866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.213114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.213604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.214128 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.214682 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.215024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.215360 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.215770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.216027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.216478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.217115 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.217460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.217785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.218129 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.218472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.218805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.219189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.219604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.219922 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.220243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.220631 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.221845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.221845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.222171 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.222683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.223270 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.223610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.223966 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.224393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.224726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.225050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.225381 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.225713 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.226885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.228751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.229089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.229431 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.229773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.230118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.230379 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.230879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.231202 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.231592 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.232014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.232343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.232814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.233130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.233448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.233881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.234896 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.235144 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.235492 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.235754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.236055 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.236372 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.236688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.237004 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.237335 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.237664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.238459 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.238784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.239103 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.239421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.239751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.240068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.240898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.240898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.241346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.241593 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.241885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.242135 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.242364 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.242685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.243054 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.243311 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.244665 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.245009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.245163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.245368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.245677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.246032 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.246348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.246662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.246975 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.247370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.247627 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.247917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.248217 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.248539 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.248850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.249176 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.249720 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.251412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.251412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.251913 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.252153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.252468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.252802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.253183 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.253434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.254822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.254822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.254822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.254822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.255709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.255709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.255994 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.256198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.256546 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.256878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.257195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.257520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.257931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.258219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.258520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.258879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.259228 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.259550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.259881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.260319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.260796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.261126 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.261449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.262548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.262879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.263665 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.264130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.264390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.264754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.265351 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.265540 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.266048 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.266377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.266700 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.267052 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.267382 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.267708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.269861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.269861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.269861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.269861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.270349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.270684 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.271028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.271413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.271732 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.272814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.272814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.272814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.273284 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.274586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.276900 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.277463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.278042 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.278591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.279135 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.279670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.280218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.280757 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.281344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.281931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.282462 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.282994 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.283812 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.284322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.284894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.285501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.285969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.286499 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.286982 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.287477 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.288005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.289031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.289031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.289570 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.290185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.290663 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.291205 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.291743 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.292292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.292793 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.293290 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.293776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.294306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.294810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.295303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.295823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.296314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.297369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.297856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.298360 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.298881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.299380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.299909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.300343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.300696 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.301090 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.301433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.301794 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.302170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.302507 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.302847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.303175 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.303504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.303915 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.304243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.304882 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.306109 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.306109 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.306422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.306562 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.306827 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.307167 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.307493 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.307944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.308476 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.309003 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.309576 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.310180 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.310604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.310945 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.311274 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.311603 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.311931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.312310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.313153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.313699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.313920 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.314137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.314725 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.315166 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.315569 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.315965 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.316409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.317481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.317481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.318647 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.319190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.319734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.320237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.320771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.321280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.321783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.322310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.322790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.323290 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.323789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.324314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.325078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.325339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.325771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.326339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.326866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.328506 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.328506 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.328506 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.329256 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.329491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.330031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.330600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.331077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.331610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.332110 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.332615 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.333107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.333604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.334203 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.334699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.335210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.335703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.336365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.336725 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.337236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.338571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.338571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.339187 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.339430 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.339813 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.340310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.340822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.341326 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.342502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.343141 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.343743 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.344318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.344877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.345426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.346014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.347218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.347411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.348302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.350735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.350735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.350735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.351166 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.351740 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.352534 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.353100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.353648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.354412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.355029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.355412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.355959 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.356773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.357229 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.357760 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.358328 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.359575 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.360053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.360610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.361413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.361934 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.362435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.362975 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.363525 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.364062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.364807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.365330 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.365879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.366399 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.367289 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.367633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.368061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.368672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.369933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.369933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.370892 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.371422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.371933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.372460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.372991 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.373519 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.374082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.374607 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.376143 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.376308 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.376742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.377271 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.378577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.379110 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.379902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.380168 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.380709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.381351 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.382008 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.382383 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.382907 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.383458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.384848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.384848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.385426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.385865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.386429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.386912 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.388253 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.388253 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.388744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.388744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.389547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.390155 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.391120 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.391652 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.392188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.392728 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.393259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.393901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.396943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.397367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.397911 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.398462 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.398995 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.399525 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.400043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.400578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.401071 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.401560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.402073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.402590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.403117 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.403661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.404186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.404698 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.405299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.405851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.406677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.407394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.409226 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.409226 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.409226 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.410029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.410294 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.410801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.411406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.411933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.412749 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.413592 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.413863 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.414398 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.414928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.415619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.416305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.416946 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.417581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.418163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.418718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.419245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.420043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.420826 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.422097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.422781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.424118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.424118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.424590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.425151 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.425695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.426386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.426806 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.427358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.428118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.428448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.429000 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.429547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.430128 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.430662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.431800 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.432073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.432591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.433247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.433786 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.434352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.435165 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.435416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.436185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.436743 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.438063 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.438580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.439351 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.439855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.440369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.440893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.441435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.442006 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.442791 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.443358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.443894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.444434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.445009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.445788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.446395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.446922 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.447669 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.448349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.448819 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.451940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.451940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.451940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.451940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.451940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.452552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.455628 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.455628 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.455628 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.456059 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.456472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.457864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.457864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.458406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.458656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.459234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.459880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.460358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.461090 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.461700 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.462225 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.462790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.463347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.463880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.464596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.464949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.465721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.466279 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.466836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.467379 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.467932 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.469395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.470218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.470962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.471372 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.472054 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.472584 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.473139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.473766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.474354 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.474926 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.475453 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.476024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.476700 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.478085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.478085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.478390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.478781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.479470 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.479853 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.480546 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.480995 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.481500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.482120 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.482657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.483264 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.483769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.484574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.485239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.485771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.486342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.487243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.487419 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.488396 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.488396 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.488932 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.489454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.490016 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.490543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.491154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.491622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.492224 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.492643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.493097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.493606 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.494163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.494797 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.495281 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.495853 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.496385 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.497162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.497663 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.498252 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.499139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.499350 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.500879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.502028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.502028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.503157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.503157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.503683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.504242 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.505286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.505914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.506429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.506986 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.507526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.508272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.508819 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.509382 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.509967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.510739 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.511180 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.511607 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.513572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.513572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.513572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.513903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.514662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.516001 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.516794 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.517445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.518022 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.518549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.520788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.521553 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.522371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.523086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.523477 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.523999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.524862 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.525617 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.526094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.526407 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.526926 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.527482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.528067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.528634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.529267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.530348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.530859 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.531503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.532274 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.532500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.533073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.533965 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.534504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.535114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.535623 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.536164 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.536698 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.537230 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.537776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.538546 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.539323 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.539863 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.540683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.540951 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.541498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.542454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.543440 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.543665 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.544554 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.544776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.545265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.545831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.546390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.547760 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.547760 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.548798 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.549343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.549948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.550420 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.550994 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.551511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.553866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.553866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.553866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.553866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.554490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.554921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.555460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.556014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.556560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.557099 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.557646 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.558985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.559587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.560202 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.560905 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.562023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.562023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.564851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.564851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.564851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.564851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.565238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.565980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.566368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.566910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.567478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.568028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.568621 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.569173 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.569718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.570973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.571499 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.572132 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.572644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.573218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.573799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.574654 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.574831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.575394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.575876 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.576413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.577523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.577523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.578773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.579188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.579717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.580243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.580770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.581495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.581843 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.582369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.582895 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.584317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.584872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.586214 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.586214 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.586782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.587322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.587897 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.588476 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.589009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.589542 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.590112 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.590657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.591219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.591850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.592751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.592992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.593567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.594146 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.594728 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.595263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.595825 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.596863 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.597046 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.597464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.598037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.598620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.599201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.599772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.600344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.602265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.602265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.604978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.604978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.604978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.604978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.604978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.605619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.606131 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.606662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.607210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.608641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.608641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.608940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.609503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.610241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.612612 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.612612 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.612612 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.612612 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.613194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.617903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.617903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.617903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.617903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.617903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.617903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.617903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.617903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.618962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.618962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.619219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.620142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.620319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.620743 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.621289 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.621867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.622413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.623337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.623496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.624013 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.624548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.627011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.627011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.627337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.627820 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.628351 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.628905 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.629455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.630027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.630571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.631119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.631689 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.632287 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.632967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.633514 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.634104 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.634658 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.635458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.635743 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.636296 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.636855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.637412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.638039 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.638577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.639268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.639841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.640482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.641575 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.642218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.643186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.643358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.643818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.644919 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.644919 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.645304 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:21:49.761442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO dbcounter [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Registered counter for database nova_api Sep 02 21:21:49.794792 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_db.sqlalchemy.engines [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:21:49.807976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writer thread running {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:21:49.849901 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 21:21:49.850743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 21:21:49.851225 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 21:21:49.851828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 21:21:49.852251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 21:21:49.852892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.853443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.854004 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.854532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.855367 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.855893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.856441 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.856992 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.857607 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.858076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.858609 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.860012 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852209-11-iscsi {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.860521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.861047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.861843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.862611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.863357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.864124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.864893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.865921 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.866456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.866998 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.867553 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.868135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.868692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.869218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.870004 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.870748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.871313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.871863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.872542 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852209-11-iscsi {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.873113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.873639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.874199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.874974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.875515 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.876050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.876612 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.877160 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.877688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.878285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.878829 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.879376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.879933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.880463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.881012 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.881571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.882160 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.882697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.883237 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.883670 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.884210 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.884766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.885325 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.885929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.886362 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.887015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.887804 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.888368 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.888904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.889434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.889999 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.891088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.893834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.893834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.893834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.893834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.893834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.894461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.894824 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.895361 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.895916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.896624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.897051 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.897724 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.898182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.898739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.899355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.899789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.900327 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.900855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.901412 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.902013 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.902534 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.903100 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.903631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.904065 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.904590 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.905127 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.905898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.907250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.907445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.907851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.908371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.909148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.909664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.910221 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.910762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.911312 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.911849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.912373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.912897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.913433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.914073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.context [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65d0b9d2-8f86-4245-a4cb-5092df7bfecb(cell1) {{(pid=121513) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 21:21:49.914736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.915299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.915849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.916391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.916927 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.918288 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.918288 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.918601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.919029 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.919570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.920110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.920641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.921295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.921723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.922100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:21:49.922276 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.923331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.923535 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:21:49.923689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.924111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.924373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.924927 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.925447 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.925995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.926157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:21:49.926520 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.927047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.927334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:21:49.928016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.928201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:21:49.928355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.928577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.929092 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.929602 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.930182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.930817 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.931246 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.932180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.932437 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:21:49.932722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.932965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 21:21:49.933376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.933959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.934500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.935024 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.935643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO dbcounter [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Registered counter for database nova_cell0 Sep 02 21:21:49.935904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.936173 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.937559 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.937559 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.938112 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.938406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.938948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.939493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.940023 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.940564 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.941514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.942077 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.942623 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.943135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.944463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.944685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO dbcounter [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Registered counter for database nova_cell1 Sep 02 21:21:49.944988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.945542 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.946225 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.946809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.947261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.948094 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.948772 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.949769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.950668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.951308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.954793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.955344 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.955884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.956463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.956983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.957454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.957949 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.958496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.959031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.959481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_db.sqlalchemy.engines [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:21:49.959663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.960097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.960651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.961195 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.961859 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.962614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.963147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.963931 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.964713 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.965515 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.966148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.966743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.967341 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.967914 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.970008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.970008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.970380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.970784 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.971346 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.972000 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.972897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.973103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.973506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.974884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.975151 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_db.sqlalchemy.engines [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:21:49.975402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.975402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.975869 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.976116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.976494 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.977016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.977542 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.978823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writer thread running {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:21:49.979078 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.979078 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.979561 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.979800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.980266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.980807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.981342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.983948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.983948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.983948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.984690 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.985057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.990939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.990939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.990939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.990939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.990939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.990939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.990939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.990939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.992897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.992897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.992897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.992897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.992897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.992897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.993636 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.993961 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.994389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.994857 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.995620 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.996407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.997143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.997878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.998624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.999166 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:49.999857 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.000331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.001125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.001717 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.002335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.002964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.004977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.004977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.004977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.004977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.005885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.006174 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.006678 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.007228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.008000 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.008464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.008892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.010421 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.011153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.011823 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.012516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.013242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.014269 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.015060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.015974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.016645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.017763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.018612 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.019810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.019810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.021356 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.022155 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.022748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.023351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.023936 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.024547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.025255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.025723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.026373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.026926 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.027584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.028442 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.028956 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.029966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.030136 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.030730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.032533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.033788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.034033 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.034560 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.035143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.035739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.036661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.036939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.037470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.038332 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.038892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.039486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.040036 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.040663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.041239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.042015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.042460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.043058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.043684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.044173 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.044773 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.045347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.045943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.046571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.047191 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.047842 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.048764 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.049190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.049788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.050417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.051119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.051716 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.052410 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.052868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.053478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.054119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.055266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.055547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.055898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.056557 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.057055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.057872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.058317 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.058953 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.059518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.060090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.060672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.061274 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.062365 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.062988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.063562 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.064153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.064833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.065431 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.066065 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.066666 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.067244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.067801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.068425 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.069065 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.069501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.070108 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.070679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.071252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.071820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.072430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.072958 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.073515 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.074113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.074683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.075264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.075833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.076427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.076978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.077575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.078717 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.079322 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.079905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.080823 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.081463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.082069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.082697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.083388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.085521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.085521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.085521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.086296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.086296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.087147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.087431 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.087850 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.088431 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.088990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.089571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.090172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.090748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.091505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.091888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.092458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.093025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.094232 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.094826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.095344 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.095917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.096507 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.097261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.097730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.098348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.098966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.099559 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.100133 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.100700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.101263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.102026 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.102466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.103126 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.103618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.104191 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.104763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.105321 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.105918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.106486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.107132 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.107705 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.108346 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.108890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.109489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.110147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.110720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.111292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.111871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.112446 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.113031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.113596 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.114197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.114770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.115350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.115952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.116535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.117106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.117684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.118290 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.118936 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.119503 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.120167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.120736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.121317 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.122070 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.122525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.123127 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.123685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.124258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.124873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.125456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.126060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.126630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.127202 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.127807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.128403 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.128985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.129572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.130201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.130806 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.131376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.132040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.132625 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.133205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.133779 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.134386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.134970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.135552 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.136121 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.136702 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.137314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.137948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.138510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.139083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.139651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.140825 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.141375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.141958 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.142537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.143109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.143689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.144272 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.145060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.145743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.146248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.146817 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.147393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.147975 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.148571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.149154 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.149723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.150527 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.151144 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.151722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.152296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.152858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.153424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.154026 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.154619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.155189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.155749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.156871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.157476 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.158081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.158952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.159732 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.160367 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.160936 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.161707 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.162318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.162899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.163500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.164095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.164701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.165273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.165887 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.166465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.167069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.167668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.168249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.169151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.169443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.170042 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.170653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.171237 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.171947 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.172734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.173329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.173939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.174541 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.175137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.175704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.176266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.176851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.177411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.178004 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.178601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.179172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.179752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.180329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.180900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.181458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.182054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.182626 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.183200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.183797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.184413 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.185044 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.185684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.186251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.186849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.187460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.188414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.188994 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.189609 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.190245 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.190819 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.191421 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.192087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.192637 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.193222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.193475 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writer thread running {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:21:50.194303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.194549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.195039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.195608 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.196222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.196891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.197383 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.198091 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.198742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.199313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.200297 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.200547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.201080 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.201677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.202278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.203766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.204034 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.204564 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.205125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.205700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.206294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.206900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.207190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO dbcounter [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Registered counter for database nova_cell0 Sep 02 21:21:50.207439 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.208090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.208659 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.209280 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.210072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.210686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.211177 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.211759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.212340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.212917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.213506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.214126 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.214876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.215289 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.215871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.216762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.217616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.219490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.220105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.220694 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.220979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_db.sqlalchemy.engines [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:21:50.221287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.221996 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.222710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.223187 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.223776 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.224361 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.224944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.225524 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.226172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.226779 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.227343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writer thread running {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:21:50.227597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.228014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.228593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.229188 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.229831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.230402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.231056 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.231638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.232204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.233103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.233466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.234120 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.234711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.235303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.235886 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.236469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.237062 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.237636 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.238252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.238840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.239455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.240074 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.240676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.241262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.241873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.242463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.243471 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.244051 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.244656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.245254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.245875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.246454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.247032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.247634 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.248195 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.248794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.249342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.250491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.251056 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.251657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.253259 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.253259 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.253692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.254076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.255017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.255652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.256247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.256851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.257453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.258073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.258645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.259250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.259821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.260392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.261002 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.261559 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.262176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.262746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.263328 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.263905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.264652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.265070 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.266275 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.266890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.267466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.268037 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.268608 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.269206 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.269768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.270369 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.270936 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.271535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.272107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.272685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.273418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.274013 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.274599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.275285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.275813 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.276387 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.276992 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.277576 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.278146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.278736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.279377 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.279908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.280489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.281099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.281752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.282368 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.283419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.284285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.284892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.285505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.286141 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.286714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.287282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.287855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.288452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.289034 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.289728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.290212 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.290793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.291369 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.291943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.292537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.293086 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.293658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.294262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.294838 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.295602 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.296050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.296652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.297251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.297966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.298516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.299106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.299803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.300288 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.300867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.301491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.302097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.302751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.303261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.303869 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.304450 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.305021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.305833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.306444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.307028 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.307622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.308198 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.308793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.309397 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.310009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.310594 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.311164 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.311765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.312962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.313595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.314169 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.314741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.315311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.315898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.316465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.317047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.317622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.318291 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.318794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.319373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.319946 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.320526 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.321095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.321701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.322265 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.322827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.323392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.323997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.324523 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.325088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.325656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.326264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.326826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.327389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.328546 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.329098 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.329946 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.330584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.331204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.331863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.332407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.332985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.333584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.334211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.334797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.335474 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.335985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.336571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.337187 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.337769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.338372 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.338949 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.339535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.340113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.340692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.341298 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.342010 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.342478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.343086 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.343721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.344605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.345192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.345773 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.346446 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.346993 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.347574 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.348156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.348876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.349318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.349950 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.350539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.351121 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.351713 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.352298 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.352901 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.353504 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.354108 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.354710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.355314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.355953 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.356761 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.357152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.357746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.358354 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.359181 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.359542 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 21:21:50.359987 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 21:21:50.488697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO dbcounter [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Registered counter for database nova_api Sep 02 21:21:50.525121 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_db.sqlalchemy.engines [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:21:50.538164 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writer thread running {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:21:50.627677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.context [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),65d0b9d2-8f86-4245-a4cb-5092df7bfecb(cell1) {{(pid=121512) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 21:21:50.632359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:21:50.633951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:21:50.634517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:21:50.635400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:21:50.635863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:21:50.637953 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:21:50.640037 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO dbcounter [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Registered counter for database nova_cell0 Sep 02 21:21:50.647682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO dbcounter [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Registered counter for database nova_cell1 Sep 02 21:21:50.659364 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_db.sqlalchemy.engines [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:21:50.662208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_db.sqlalchemy.engines [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:21:50.675691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writer thread running {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:21:50.678168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writer thread running {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:21:50.824435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: WARNING keystonemiddleware.auth_token [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:21:50.841020 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: WARNING keystonemiddleware.auth_token [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:21:50.870240 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO dbcounter [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Registered counter for database nova_cell0 Sep 02 21:21:50.883504 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_db.sqlalchemy.engines [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 21:21:50.889155 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writer thread running {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 02 21:21:51.304022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: WARNING keystonemiddleware.auth_token [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:21:51.313262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: WARNING keystonemiddleware.auth_token [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:21:51.409218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: WARNING keystonemiddleware.auth_token [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:21:51.420990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: WARNING keystonemiddleware.auth_token [None req-8a39282a-0be1-4c80-9323-2f9f57c7f426 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:21:51.427855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x5578a4b9d9c0 pid: 121513 (default app) Sep 02 21:21:51.715620 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: WARNING keystonemiddleware.auth_token [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 21:21:51.724281 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: WARNING keystonemiddleware.auth_token [None req-d4775e91-10a7-4d43-a7c7-d20cee631a38 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 21:21:51.730487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: WSGI app 0 (mountpoint='') ready in 9 seconds on interpreter 0x5578a4b9d9c0 pid: 121512 (default app) Sep 02 21:22:34.135591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:34.137119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:34.138028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:34.139068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:35.395775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2957869c-0844-4594-8e6b-45d5e2c89561 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Action: 'create', calling method: .version_select at 0x7fb00dc46280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-61331557"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:22:38.143730 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2957869c-0844-4594-8e6b-45d5e2c89561 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.019485 Sep 02 21:22:38.144428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1155 bytes} [Fri Sep 2 21:22:34 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4024 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 21:22:38.175064 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:38.179146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:38.182637 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:38.182637 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:22:38.716915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-28ba8698-ab19-451a-9fd0-156736263ffb tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dcff940>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:39.418271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-28ba8698-ab19-451a-9fd0-156736263ffb tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160" status: 200 len: 343 microversion: 2.1 time: 1.250123 Sep 02 21:22:39.421386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 1/2] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:22:38 2022] GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 => generated 343 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:40.442003 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b03056c1-5f43-44c4-89bc-12715a080fa7 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00db26160>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:40.577139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b03056c1-5f43-44c4-89bc-12715a080fa7 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160" status: 200 len: 344 microversion: 2.1 time: 0.139510 Sep 02 21:22:40.577703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:22:40 2022] GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:40.593912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9f8634f3-b24e-406b-8404-26c731089d69 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Action: 'create', calling method: .version_select at 0x7fb00db043a0>, body: {"snapshot": {"volume_id": "cb9e6541-125b-4f20-97d8-ab9e74b72160", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-757905666"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:22:41.578765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9f8634f3-b24e-406b-8404-26c731089d69 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.990654 Sep 02 21:22:41.579335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 2/4] 10.222.0.79 () {60 vars in 1162 bytes} [Fri Sep 2 21:22:40 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:41.591888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9cdabf4a-d895-4e28-9b43-db349643a4b8 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00db26820>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:41.664814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9cdabf4a-d895-4e28-9b43-db349643a4b8 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 200 len: 286 microversion: 2.1 time: 0.077117 Sep 02 21:22:41.673196 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 3/5] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:22:41 2022] GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:41.682085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-008f8d7e-095c-452f-bc8d-a6c6da7f5bca tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00db04040>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:41.817286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-008f8d7e-095c-452f-bc8d-a6c6da7f5bca tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.142639 Sep 02 21:22:41.826005 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 3/6] 10.222.0.79 () {58 vars in 1140 bytes} [Fri Sep 2 21:22:41 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:22:41.831888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a4ea88bf-2210-4b36-b9ac-167f110797b9 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00db26f70>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:41.904020 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a4ea88bf-2210-4b36-b9ac-167f110797b9 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 200 len: 286 microversion: 2.1 time: 0.076180 Sep 02 21:22:41.904978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:22:41 2022] GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:22:42.925534 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-43cd6325-febd-423f-8dbc-a7680fc69fdf tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dab03a0>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:43.053977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-43cd6325-febd-423f-8dbc-a7680fc69fdf tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 200 len: 286 microversion: 2.1 time: 0.136834 Sep 02 21:22:43.054531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:22:42 2022] GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:44.074082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8e11c9c3-75ab-4807-b981-004515d8372f tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00db26af0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:44.179822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8e11c9c3-75ab-4807-b981-004515d8372f tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 200 len: 286 microversion: 2.1 time: 0.113851 Sep 02 21:22:44.180737 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 5/9] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:22:44 2022] GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:45.206736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5836a391-b378-4376-9ed5-b8c2aeff2e0f tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00db14790>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:45.380940 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5836a391-b378-4376-9ed5-b8c2aeff2e0f tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 200 len: 286 microversion: 2.1 time: 0.187007 Sep 02 21:22:45.382660 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 5/10] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:22:45 2022] GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 286 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:46.427367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c3c08a2a-7505-4b26-8f70-bfe5b59450da tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00db26280>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:46.524881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c3c08a2a-7505-4b26-8f70-bfe5b59450da tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 200 len: 287 microversion: 2.1 time: 0.123109 Sep 02 21:22:46.524881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 6/11] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:22:46 2022] GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:46.539681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-83655013-9bf6-494a-9918-a76d7cd1c4a8 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dcff040>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:46.765605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-83655013-9bf6-494a-9918-a76d7cd1c4a8 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 202 len: 0 microversion: 2.1 time: 0.223291 Sep 02 21:22:46.765605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1254 bytes} [Fri Sep 2 21:22:46 2022] DELETE /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:22:46.773549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4723792e-614a-4d2f-8a85-3957dd798c36 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dab3040>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:46.860962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4723792e-614a-4d2f-8a85-3957dd798c36 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 200 len: 286 microversion: 2.1 time: 0.093160 Sep 02 21:22:46.869147 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:22:46 2022] GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:47.876521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a5380efd-1837-474e-af7f-849bcc47f419 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00db04430>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:47.924569 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-a5380efd-1837-474e-af7f-849bcc47f419 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] HTTP exception thrown: Snapshot 81e2e7fc-980d-47e4-9176-2e833ff5e9d5 could not be found. Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a5380efd-1837-474e-af7f-849bcc47f419 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Request method failure captured: Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 HTTP/1.1 Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQa2czjt0Ha17k6GwQ_MPoKjwk2roSEB9K-9VkfSyePCMsz9hFX7M5ZuX9x5-bBd8ZpxT85Cla5O4Os7h_MPYk8inxk45Pe_v9_a0ROjEOlNKhbRPfApugklWHRayACS61ZzWDDW1jvvj0EfewceuCJJioLoC2SjtjuTcb9I8xNeQw Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: ca6e4f9f3af64916a1aae6ccb1b492a2 Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:22:47.938581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}] Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: ca6e4f9f3af64916a1aae6ccb1b492a2 Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesSnapshotsTestJSON-698523149-project Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: 7622cffd25e740bea34fdc1c80e4560f Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-698523149-project Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Snapshot 81e2e7fc-980d-47e4-9176-2e833ff5e9d5 could not be found. Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '81e2e7fc-980d-47e4-9176-2e833ff5e9d5'} Sep 02 21:22:47.940808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 81e2e7fc-980d-47e4-9176-2e833ff5e9d5 could not be found. (HTTP 404) (Request-ID: req-647ea39c-1369-4de1-8c80-3efefcd40ae0) Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:47.942915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:22:47.946591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 81e2e7fc-980d-47e4-9176-2e833ff5e9d5 could not be found. Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 02 21:22:47.951252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 81e2e7fc-980d-47e4-9176-2e833ff5e9d5 could not be found. Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 81e2e7fc-980d-47e4-9176-2e833ff5e9d5 could not be found. Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a5380efd-1837-474e-af7f-849bcc47f419 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Returning 404 to user: Snapshot 81e2e7fc-980d-47e4-9176-2e833ff5e9d5 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:22:47.955533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a5380efd-1837-474e-af7f-849bcc47f419 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5" status: 404 len: 111 microversion: 2.1 time: 0.062258 Sep 02 21:22:47.958692 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-090070c2-fbed-469e-9e75-50cc4ceac513 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dab3700>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:47.959462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 7/14] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:22:47 2022] GET /compute/v2.1/os-snapshots/81e2e7fc-980d-47e4-9176-2e833ff5e9d5 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:22:48.602291 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-090070c2-fbed-469e-9e75-50cc4ceac513 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160" status: 202 len: 0 microversion: 2.1 time: 0.655647 Sep 02 21:22:48.613049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 8/15] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:22:47 2022] DELETE /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:22:48.616050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0b1e9fb0-336d-4c79-b6ec-0d05d0d37a8d tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dab01f0>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:48.885498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0b1e9fb0-336d-4c79-b6ec-0d05d0d37a8d tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160" status: 200 len: 343 microversion: 2.1 time: 0.275188 Sep 02 21:22:48.908002 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 8/16] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:22:48 2022] GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 => generated 343 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:22:49.893901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2002158450", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "networks": [{"uuid": "3642fa22-f7c8-4624-9577-6491d3510b98"}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:22:49.922282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d2e8d813-8b3f-4e6d-90f4-20a2fd7a0f5c tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dab0e50>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:49.999828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-d2e8d813-8b3f-4e6d-90f4-20a2fd7a0f5c tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] HTTP exception thrown: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d2e8d813-8b3f-4e6d-90f4-20a2fd7a0f5c tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Request method failure captured: Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 HTTP/1.1 Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQa2czjt0Ha17k6GwQ_MPoKjwk2roSEB9K-9VkfSyePCMsz9hFX7M5ZuX9x5-bBd8ZpxT85Cla5O4Os7h_MPYk8inxk45Pe_v9_a0ROjEOlNKhbRPfApugklWHRayACS61ZzWDDW1jvvj0EfewceuCJJioLoC2SjtjuTcb9I8xNeQw Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: ca6e4f9f3af64916a1aae6ccb1b492a2 Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:22:50.002395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}] Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: ca6e4f9f3af64916a1aae6ccb1b492a2 Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesSnapshotsTestJSON-698523149-project Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: 7622cffd25e740bea34fdc1c80e4560f Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-698523149-project Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': 'cb9e6541-125b-4f20-97d8-ab9e74b72160'} Sep 02 21:22:50.003712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. (HTTP 404) (Request-ID: req-44170cbe-1809-4378-b87b-91cf66c1c593) Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.004549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:22:50.005538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 21:22:50.006577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d2e8d813-8b3f-4e6d-90f4-20a2fd7a0f5c tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Returning 404 to user: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:22:50.007514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d2e8d813-8b3f-4e6d-90f4-20a2fd7a0f5c tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160" status: 404 len: 109 microversion: 2.1 time: 0.088711 Sep 02 21:22:50.008985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 9/17] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:22:49 2022] GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:22:50.018640 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d38c8010-cbc6-4626-90b6-55c832485f63 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dab0280>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:50.104888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-d38c8010-cbc6-4626-90b6-55c832485f63 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] HTTP exception thrown: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d38c8010-cbc6-4626-90b6-55c832485f63 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Request method failure captured: Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 HTTP/1.1 Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQa2czjt0Ha17k6GwQ_MPoKjwk2roSEB9K-9VkfSyePCMsz9hFX7M5ZuX9x5-bBd8ZpxT85Cla5O4Os7h_MPYk8inxk45Pe_v9_a0ROjEOlNKhbRPfApugklWHRayACS61ZzWDDW1jvvj0EfewceuCJJioLoC2SjtjuTcb9I8xNeQw Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: ca6e4f9f3af64916a1aae6ccb1b492a2 Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:22:50.107797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}] Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: ca6e4f9f3af64916a1aae6ccb1b492a2 Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesSnapshotsTestJSON-698523149-project Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: 7622cffd25e740bea34fdc1c80e4560f Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-698523149-project Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': 'cb9e6541-125b-4f20-97d8-ab9e74b72160'} Sep 02 21:22:50.111197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. (HTTP 404) (Request-ID: req-3b48cec6-9d86-4682-b486-e5978edaef61) Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.111883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:22:50.112925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 21:22:50.113874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d38c8010-cbc6-4626-90b6-55c832485f63 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Returning 404 to user: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:22:50.115007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d38c8010-cbc6-4626-90b6-55c832485f63 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160" status: 404 len: 109 microversion: 2.1 time: 0.099726 Sep 02 21:22:50.115980 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 10/18] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:22:50 2022] DELETE /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:22:50.123899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-386e0b12-4c30-4eba-8003-ceee46df36a1 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Calling method '.version_select at 0x7fb00dab0a60>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:50.162525 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] validate_networks() for [('3642fa22-f7c8-4624-9577-6491d3510b98', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:22:50.198929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-386e0b12-4c30-4eba-8003-ceee46df36a1 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] HTTP exception thrown: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-386e0b12-4c30-4eba-8003-ceee46df36a1 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Request method failure captured: Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 HTTP/1.1 Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQa2czjt0Ha17k6GwQ_MPoKjwk2roSEB9K-9VkfSyePCMsz9hFX7M5ZuX9x5-bBd8ZpxT85Cla5O4Os7h_MPYk8inxk45Pe_v9_a0ROjEOlNKhbRPfApugklWHRayACS61ZzWDDW1jvvj0EfewceuCJJioLoC2SjtjuTcb9I8xNeQw Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: ca6e4f9f3af64916a1aae6ccb1b492a2 Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:22:50.203186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ca6e4f9f3af64916a1aae6ccb1b492a2"}]}] Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: ca6e4f9f3af64916a1aae6ccb1b492a2 Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-698523149 Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesSnapshotsTestJSON-698523149-project Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: 7622cffd25e740bea34fdc1c80e4560f Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-698523149-project Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': 'cb9e6541-125b-4f20-97d8-ab9e74b72160'} Sep 02 21:22:50.204416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. (HTTP 404) (Request-ID: req-73cd5f6c-fca8-4685-b03c-8fa00879f75f) Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.205067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:22:50.206083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 21:22:50.207151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-386e0b12-4c30-4eba-8003-ceee46df36a1 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] Returning 404 to user: Volume cb9e6541-125b-4f20-97d8-ab9e74b72160 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-386e0b12-4c30-4eba-8003-ceee46df36a1 tempest-VolumesSnapshotsTestJSON-698523149 tempest-VolumesSnapshotsTestJSON-698523149-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160" status: 404 len: 109 microversion: 2.1 time: 0.088490 Sep 02 21:22:50.208107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 11/19] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:22:50 2022] GET /compute/v2.1/os-volumes/cb9e6541-125b-4f20-97d8-ab9e74b72160 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:22:53.472159 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:22:53.472890 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:22:53.474542 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:22:53.475170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:22:53.475736 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:22:53.513137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:53.514366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:53.516388 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:53.522308 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:53.531434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:53.532476 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:53.655127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Getting quotas for project 90aa668555c54d508063d931dba2d751. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:22:53.678544 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Getting quotas for user 02bf6738503a44b0908ecd38116842d2 and project 90aa668555c54d508063d931dba2d751. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:22:53.702730 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:22:53.707777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:22:54.021712 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e2314f12-b4d2-4ed6-beb1-75e01d68dc81 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.596862 Sep 02 21:22:54.022978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 9/20] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:22:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:22:54.046312 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8a29f66e-7770-483c-9d12-0d3ea1374b69 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:54.047643 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8a29f66e-7770-483c-9d12-0d3ea1374b69 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:22:54.660911 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8a29f66e-7770-483c-9d12-0d3ea1374b69 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:22:54.712279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8a29f66e-7770-483c-9d12-0d3ea1374b69 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1215 microversion: 2.1 time: 0.675050 Sep 02 21:22:54.712787 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 12/21] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:22:54 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1215 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:22:55.758498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-24ba1385-ba53-4592-a1fb-4ace6c9fe91d tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:55.763176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-24ba1385-ba53-4592-a1fb-4ace6c9fe91d tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:22:55.847233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-871034035", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:22:56.033290 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] validate_networks() for [('3b84c7e7-9382-422d-bbad-24b7eb0f0aad', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:22:56.425836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-24ba1385-ba53-4592-a1fb-4ace6c9fe91d tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:22:56.466897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-24ba1385-ba53-4592-a1fb-4ace6c9fe91d tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1215 microversion: 2.1 time: 0.709033 Sep 02 21:22:56.504248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 13/22] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:22:55 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1215 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:22:57.522627 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b7c12182-e9b8-405c-a8a1-c8f09fa84a83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:57.524498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b7c12182-e9b8-405c-a8a1-c8f09fa84a83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:22:57.785340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b7c12182-e9b8-405c-a8a1-c8f09fa84a83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:22:57.817552 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b7c12182-e9b8-405c-a8a1-c8f09fa84a83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1215 microversion: 2.1 time: 0.302849 Sep 02 21:22:57.835558 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 14/23] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:22:57 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1215 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:22:58.860112 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:22:58.861384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:22:58.879395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:58.881614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:58.883966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:58.885770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:58.887324 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:58.888594 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:59.575649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:22:59.600760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d29a7e4c-3ed9-4751-b52d-a4382ac030ba tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1219 microversion: 2.1 time: 0.757192 Sep 02 21:22:59.601642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 15/24] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:22:58 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1219 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:22:59.645477 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:22:59.646810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:22:59.647484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:22:59.648044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:22:59.648620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:22:59.666367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:59.672596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:59.678605 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:59.678605 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:22:59.678605 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:22:59.678605 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:22:59.740206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Getting quotas for project 347df6259a3e48fcbdcbb3f895d38bd4. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:22:59.750244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Getting quotas for user c81bafbe3e444e84a7da18ac9d782479 and project 347df6259a3e48fcbdcbb3f895d38bd4. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:22:59.779379 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:22:59.782894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:23:00.039693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8c24031c-ac69-4ae6-97cf-7d3bf0df7ce2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.843923 Sep 02 21:23:00.048368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 10/25] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:22:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 4846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:23:00.061366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3fdf4630-11ee-4d65-9288-514010b28352 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:00.061366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3fdf4630-11ee-4d65-9288-514010b28352 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:00.139179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-cc35a36c-5f37-4105-ad59-35e56faafbf8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'create', calling method: .version_select at 0x7fb00d9c6b80>, body: {"keypair": {"name": "tempest-keypair-1906605137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9xdJFzvQw4lFb0OpyJosyL06PjQDRIac5rpY21lLD9B4j+KgOyr+tw9KsZ3iXTIh0Y2dCll60QXSOoP0av8FwM1s2kXNMqcIbZ1bKG29RaSYnSUM9ifWV0lFF24gXTew=="}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:00.259135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-cc35a36c-5f37-4105-ad59-35e56faafbf8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Getting quotas for project 6dbbc6a603794466b64e5822ea9a19f3. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:23:00.261928 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-cc35a36c-5f37-4105-ad59-35e56faafbf8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Getting quotas for user aa84378418324708b40f0791e2217ccc and project 6dbbc6a603794466b64e5822ea9a19f3. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:23:00.522042 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-cc35a36c-5f37-4105-ad59-35e56faafbf8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.918774 Sep 02 21:23:00.523479 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 16/26] 10.222.0.79 () {62 vars in 1200 bytes} [Fri Sep 2 21:22:59 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 921 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 21:23:00.596875 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3fdf4630-11ee-4d65-9288-514010b28352 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:00.632537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:00.633640 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:00.665831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:00.675061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:00.675899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:00.676909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:00.682294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:00.685587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:00.696466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3fdf4630-11ee-4d65-9288-514010b28352 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1221 microversion: 2.1 time: 0.644839 Sep 02 21:23:00.720239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 11/27] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:00 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1221 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:01.059422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:01.093459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-56b83132-5931-49bb-b24f-58e3fbc397b6 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1267 microversion: 2.1 time: 0.465536 Sep 02 21:23:01.098146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 17/28] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:00 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1267 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:01.369186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1348904100", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:01.708208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.network.neutron [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] validate_networks() for [('3b84c7e7-9382-422d-bbad-24b7eb0f0aad', None, None, None, None, None)] {{(pid=121512) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:23:02.317957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d1bd13e2-e7cc-47ec-8bef-27c83ae8d741 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'create', calling method: .version_select at 0x7fb00d1c4820>, body: {"keypair": {"name": "tempest-keypair-1601535252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAxyn6g++cyATejDRg8GHwGX/O2HgU6cEIHCUzqIU7exsQmfvZc+4BMNkY9L1YnclnXHJHUo479waRZO8gP4sfqkgp+ZIo3MePWgYcxmaEyMOZ+r0wGd4qo964zaHxDPw=="}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:02.409108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-d1bd13e2-e7cc-47ec-8bef-27c83ae8d741 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Getting quotas for project a7b20efaf7e440f9bbf2a1a0df19c556. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:23:02.428846 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-d1bd13e2-e7cc-47ec-8bef-27c83ae8d741 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Getting quotas for user cceaf0c4877a4316af9d15c642c9dfc4 and project a7b20efaf7e440f9bbf2a1a0df19c556. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:23:02.641623 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d1bd13e2-e7cc-47ec-8bef-27c83ae8d741 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.480845 Sep 02 21:23:02.642442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 12/29] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:23:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:02.648241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-22580c48-60bd-494c-b1c3-3d308536bd19 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d1d4b80>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:02.838599 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-22580c48-60bd-494c-b1c3-3d308536bd19 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/1c4e7264-d00d-4fce-8e1b-cf2127ee5856" status: 200 len: 350 microversion: 2.1 time: 0.194956 Sep 02 21:23:02.840309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 13/30] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:23:02 2022] GET /compute/v2.1/os-volumes/1c4e7264-d00d-4fce-8e1b-cf2127ee5856 => generated 350 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:02.846677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:02.860333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:02.860333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:02.860333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:02.860333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:02.860928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:02.861152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:02.863741 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:03.502630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:03.591501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4337db69-2652-478d-a374-65600a3eb576 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1273 microversion: 2.1 time: 0.749871 Sep 02 21:23:03.593144 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 14/31] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:02 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1273 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:04.596818 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Flavor limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:23:04.600769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Image limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:23:04.601406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Flavor pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:23:04.601882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Image pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:23:04.602551 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:23:04.626918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:04.627414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:04.627910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:04.630279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:04.630279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:04.630279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:04.644743 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:04.645358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:04.672642 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:04.675114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:04.675114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:04.677185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:04.678222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:04.679054 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:04.729585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Getting quotas for project 347df6259a3e48fcbdcbb3f895d38bd4. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:23:04.740036 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Getting quotas for user c81bafbe3e444e84a7da18ac9d782479 and project 347df6259a3e48fcbdcbb3f895d38bd4. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:23:04.775144 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Going to run 1 instances... {{(pid=121512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:23:04.779900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:23:04.860377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:04.896572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e92aab37-3700-4c57-90ee-603f105302c5 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1273 microversion: 2.1 time: 0.255690 Sep 02 21:23:04.898218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 15/32] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:04 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1273 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:05.156752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1b80a332-4ec4-4789-b214-184c1507ef63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.802682 Sep 02 21:23:05.158952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 18/33] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:23:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:23:05.177950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8382b7ed-1806-4468-a6a8-85e8024fc58b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:05.179007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8382b7ed-1806-4468-a6a8-85e8024fc58b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:05.491773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8382b7ed-1806-4468-a6a8-85e8024fc58b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:05.534353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8382b7ed-1806-4468-a6a8-85e8024fc58b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1222 microversion: 2.1 time: 0.354693 Sep 02 21:23:05.543234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 16/34] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:05 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1222 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:05.893491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a38f707c-7734-4187-9d25-4f3dc54b15da tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d82fb80>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:05.943968 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:05.944748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:05.982766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:05.983333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:05.983882 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:05.986299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:05.987122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:06.012656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:06.166187 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a38f707c-7734-4187-9d25-4f3dc54b15da tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/cea53d1b-6a66-4e13-8589-0f1c96964b04" status: 200 len: 351 microversion: 2.1 time: 0.278506 Sep 02 21:23:06.166595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 19/35] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:23:05 2022] GET /compute/v2.1/os-volumes/cea53d1b-6a66-4e13-8589-0f1c96964b04 => generated 351 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:23:06.579078 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0b06959f-7921-4394-b328-64881d0e7cea tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:06.580093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0b06959f-7921-4394-b328-64881d0e7cea tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:07.374839 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0b06959f-7921-4394-b328-64881d0e7cea tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:07.386041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0b06959f-7921-4394-b328-64881d0e7cea tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1222 microversion: 2.1 time: 0.813818 Sep 02 21:23:07.386944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 20/36] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:06 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1222 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:07.816803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:07.862990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-cad31d14-0aac-4238-92c2-32c5c847b2d8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 1.922558 Sep 02 21:23:07.862990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 17/37] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:05 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:08.420996 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:08.422293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:08.437570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:08.439672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:08.441900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:08.444858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:08.451279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:08.456406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:08.774400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:08.779645 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-43743e5a-6abd-49c8-9e2f-359839e1dd2d tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d0bbaf0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:08.833838 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-939dadee-5389-4070-aa7d-167a7d7c94cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1226 microversion: 2.1 time: 0.418117 Sep 02 21:23:08.843881 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 21/38] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:08 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1226 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:08.891343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:08.892539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:08.908661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:08.909961 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:08.916039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:08.918399 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:08.921977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:08.922833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:09.037917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-43743e5a-6abd-49c8-9e2f-359839e1dd2d tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/fb73ed76-8c2c-4ceb-b75e-7f763c5af70c" status: 200 len: 351 microversion: 2.1 time: 0.264258 Sep 02 21:23:09.054730 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 18/39] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:23:08 2022] GET /compute/v2.1/os-volumes/fb73ed76-8c2c-4ceb-b75e-7f763c5af70c => generated 351 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:23:09.071164 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-01e49379-997b-407d-b5bc-f51b5299961c tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d18f5e0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:09.572301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-01e49379-997b-407d-b5bc-f51b5299961c tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.510773 Sep 02 21:23:09.586897 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 19/40] 10.222.0.79 () {58 vars in 1134 bytes} [Fri Sep 2 21:23:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:09.598779 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-935836c3-5773-49f8-af04-65a1de7659de tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d06e5e0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:09.711085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=4 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:09.797664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-935836c3-5773-49f8-af04-65a1de7659de tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.208134 Sep 02 21:23:09.798752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 20/41] 10.222.0.79 () {58 vars in 1149 bytes} [Fri Sep 2 21:23:09 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:09.821041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-338cd8e4-8801-4afa-9509-f9a2c08e1e83 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00e474670>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:09.989117 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:10.008414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a07eed0f-742a-4e6e-a5c1-d16da8d82e6c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 1.123835 Sep 02 21:23:10.014674 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 22/42] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:08 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:10.037168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:10.037168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:10.058470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:10.060645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:10.064801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:10.066239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:10.066930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:10.071400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:10.091505 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-338cd8e4-8801-4afa-9509-f9a2c08e1e83 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.274416 Sep 02 21:23:10.102607 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 21/43] 10.222.0.79 () {58 vars in 1134 bytes} [Fri Sep 2 21:23:09 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:10.118200 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3e3e6692-4c54-4ab0-898a-fadd37a659f0 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d0e0310>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:10.265522 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:10.279568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c3109421-2d85-4cd5-af15-2e6209bce676 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1274 microversion: 2.1 time: 0.263285 Sep 02 21:23:10.282180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 23/44] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:10 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1274 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:10.328518 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3e3e6692-4c54-4ab0-898a-fadd37a659f0 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.224365 Sep 02 21:23:10.329441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 22/45] 10.222.0.79 () {58 vars in 1167 bytes} [Fri Sep 2 21:23:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:10.346667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-cda8e409-69cf-40b4-9d73-38c3bb050ed4 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d84d5e0>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:10.598473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-cda8e409-69cf-40b4-9d73-38c3bb050ed4 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.245915 Sep 02 21:23:10.598473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 24/46] 10.222.0.79 () {58 vars in 1170 bytes} [Fri Sep 2 21:23:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:10.607334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5eb5b54a-59d2-4911-86fd-fc0c0445d7b4 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d07c310>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:10.802582 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5eb5b54a-59d2-4911-86fd-fc0c0445d7b4 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.200257 Sep 02 21:23:10.805729 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 23/47] 10.222.0.79 () {58 vars in 1155 bytes} [Fri Sep 2 21:23:10 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:10.819775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1d1907f9-d56b-492e-aa2e-5aaffbf8d9b7 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d861040>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:10.999255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1d1907f9-d56b-492e-aa2e-5aaffbf8d9b7 tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.183345 Sep 02 21:23:11.021084 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-eefecd5a-622d-4967-9d58-f64aa95f6a4a tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] Calling method '.version_select at 0x7fb00d0e0160>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:11.026119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 25/48] 10.222.0.79 () {58 vars in 1188 bytes} [Fri Sep 2 21:23:10 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:11.042630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:11.046287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:11.072749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:11.076307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:11.077005 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:11.084148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:11.087169 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:11.087630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:11.307314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-eefecd5a-622d-4967-9d58-f64aa95f6a4a tempest-VolumesTestJSON-2044212375 tempest-VolumesTestJSON-2044212375-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.292943 Sep 02 21:23:11.320874 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 24/49] 10.222.0.79 () {58 vars in 1155 bytes} [Fri Sep 2 21:23:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:11.326655 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:11.331949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:11.348941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:11.349634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:11.350347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:11.351623 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:11.352339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:11.355151 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:11.544842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:11.564558 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-05d3bdd8-84e6-45c6-bc59-604d7b432d94 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1280 microversion: 2.1 time: 0.242294 Sep 02 21:23:11.580050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 25/50] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:11 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1280 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:12.595901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:12.596586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:12.613419 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:12.620557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:12.623843 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:12.627359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:12.631600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:12.632334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:12.946484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:12.956001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:12.966322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e9d5a9ec-c72b-4436-87ce-a53f82084363 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1280 microversion: 2.1 time: 0.375084 Sep 02 21:23:12.966969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 26/51] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:12 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1280 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:13.020500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e09a981a-3bfe-4ab7-96f4-9616837418e7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 1.982291 Sep 02 21:23:13.039081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 26/52] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:11 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 2002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:13.300857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1604715865", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8efd99c-ea04-4a0f-885a-18eabae1facd"}], "security_groups": [{"name": "tempest-securitygroup--65878446"}], "key_name": "tempest-keypair-1906605137", "user_data": "}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:13.994624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:13.996214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:14.020408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:14.021490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:14.022388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:14.023906 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:14.037873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:14.037873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:14.295093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] validate_networks() for [('e8efd99c-ea04-4a0f-885a-18eabae1facd', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:23:14.475591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:14.491680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fc09b55c-721b-4c77-a169-8672d157ea70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1280 microversion: 2.1 time: 0.501419 Sep 02 21:23:14.495805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 27/53] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:13 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1280 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:14.501097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:14.509894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:14.528486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:14.529411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:14.530273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:14.532441 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:14.534331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:14.537342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:14.671723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:15.528283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=20 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:15.730304 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:15.776248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-209b4842-ef7f-4b72-995f-1e9c0ab5fa90 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 1.280515 Sep 02 21:23:15.777220 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 28/54] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:14 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:15.805082 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:15.808816 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:15.817505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:15.818757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:15.820263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:15.821632 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:15.823366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:15.824565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:16.281451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:16.310786 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ff31ecb8-0728-4eca-a324-9906ee34dd7e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1280 microversion: 2.1 time: 0.526564 Sep 02 21:23:16.311379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 29/55] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:15 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1280 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:16.467647 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-a01e7d93-d863-4707-a875-080ec61015dc req-6aa1a076-0ed7-4eeb-b8a0-879685284017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cd645d-2c7b-4d0e-889b-2a84f911b5d2", "tag": "22e52286-ac23-4daa-89c9-c5ad908c745a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:16.516502 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a01e7d93-d863-4707-a875-080ec61015dc req-6aa1a076-0ed7-4eeb-b8a0-879685284017 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:16.516991 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a01e7d93-d863-4707-a875-080ec61015dc req-6aa1a076-0ed7-4eeb-b8a0-879685284017 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:16.518362 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a01e7d93-d863-4707-a875-080ec61015dc req-6aa1a076-0ed7-4eeb-b8a0-879685284017 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:16.560330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-a01e7d93-d863-4707-a875-080ec61015dc req-6aa1a076-0ed7-4eeb-b8a0-879685284017 service nova] Creating event network-changed:22e52286-ac23-4daa-89c9-c5ad908c745a for instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 on hv-cinder-85220 Sep 02 21:23:16.567879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a01e7d93-d863-4707-a875-080ec61015dc req-6aa1a076-0ed7-4eeb-b8a0-879685284017 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 21:23:16.572238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a01e7d93-d863-4707-a875-080ec61015dc req-6aa1a076-0ed7-4eeb-b8a0-879685284017 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 21:23:16.572238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f299d247-3a59-451f-b905-2add3a17342d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:16.572238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f299d247-3a59-451f-b905-2add3a17342d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:16.572238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f299d247-3a59-451f-b905-2add3a17342d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:16.572238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f299d247-3a59-451f-b905-2add3a17342d None None] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:16.573796 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f299d247-3a59-451f-b905-2add3a17342d None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:16.584111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f299d247-3a59-451f-b905-2add3a17342d None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:16.604180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.compute.rpcapi [None req-f299d247-3a59-451f-b905-2add3a17342d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 21:23:16.608008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f299d247-3a59-451f-b905-2add3a17342d None None] Releasing lock "compute-rpcapi-router" {{(pid=121512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 21:23:16.641608 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f299d247-3a59-451f-b905-2add3a17342d None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.328308 Sep 02 21:23:16.648704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 30/56] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:16.656055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-183608988", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79be0dde-dab1-4ca7-9d75-3bc2f5b94501"}], "security_groups": [{"name": "tempest-securitygroup--21955696"}], "key_name": "tempest-keypair-1601535252", "user_data": "}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:17.324034 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.network.neutron [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] validate_networks() for [('79be0dde-dab1-4ca7-9d75-3bc2f5b94501', None, None, None, None, None)] {{(pid=121512) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:23:17.380629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=18 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:17.552045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:23:17.552644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:23:17.552936 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:23:17.553346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:23:17.553755 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:23:17.559753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=7 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:17.573053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:17.577890 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:17.582694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:17.589614 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:17.593303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:17.596837 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:17.630233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=35 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:17.669507 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Getting quotas for project 6dbbc6a603794466b64e5822ea9a19f3. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:23:17.680453 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Getting quotas for user aa84378418324708b40f0791e2217ccc and project 6dbbc6a603794466b64e5822ea9a19f3. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:23:17.702798 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:23:17.706251 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:23:17.873653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7141ed52-680c-4623-83fb-7f8f91167bb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 4.599241 Sep 02 21:23:17.878066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 27/57] 10.222.0.79 () {62 vars in 1188 bytes} [Fri Sep 2 21:23:13 2022] POST /compute/v2.1/servers => generated 400 bytes in 4607 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 21:23:18.563548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-edd2e7ba-af32-43fe-87d4-4df87a6473c8 req-e7f2a57a-5fd4-4550-b1c7-37eeced80d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3610c813-9d2a-44e4-a9a5-5652a58fd962", "tag": "abe2a65b-088e-4c84-8bc9-00a0dfa258e3"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:18.602926 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Flavor limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:23:18.604027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Image limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:23:18.604684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Flavor pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:23:18.605245 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Image pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:23:18.605827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:23:18.623581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:18.626857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-edd2e7ba-af32-43fe-87d4-4df87a6473c8 req-e7f2a57a-5fd4-4550-b1c7-37eeced80d88 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:18.627706 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:18.628347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:18.629680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:18.631302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:18.631898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:18.635722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-edd2e7ba-af32-43fe-87d4-4df87a6473c8 req-e7f2a57a-5fd4-4550-b1c7-37eeced80d88 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:18.639406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-edd2e7ba-af32-43fe-87d4-4df87a6473c8 req-e7f2a57a-5fd4-4550-b1c7-37eeced80d88 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:18.684241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Getting quotas for project a7b20efaf7e440f9bbf2a1a0df19c556. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:23:18.690236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Getting quotas for user cceaf0c4877a4316af9d15c642c9dfc4 and project a7b20efaf7e440f9bbf2a1a0df19c556. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:23:18.720912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Going to run 1 instances... {{(pid=121512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:23:18.724656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:23:18.746467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-edd2e7ba-af32-43fe-87d4-4df87a6473c8 req-e7f2a57a-5fd4-4550-b1c7-37eeced80d88 service nova] Creating event network-changed:abe2a65b-088e-4c84-8bc9-00a0dfa258e3 for instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 on hv-cinder-85220 Sep 02 21:23:18.747291 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-edd2e7ba-af32-43fe-87d4-4df87a6473c8 req-e7f2a57a-5fd4-4550-b1c7-37eeced80d88 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 02 21:23:18.747819 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-edd2e7ba-af32-43fe-87d4-4df87a6473c8 req-e7f2a57a-5fd4-4550-b1c7-37eeced80d88 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 02 21:23:18.749496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:18.750928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:18.752420 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:18.753946 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:18.753946 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:18.754661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:18.800534 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.compute.rpcapi [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 02 21:23:18.802012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] Releasing lock "compute-rpcapi-router" {{(pid=121513) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 02 21:23:18.867481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-342fd032-d4e8-43e2-8df4-ff460e7d8467 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.987748 Sep 02 21:23:18.869726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 28/58] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:18.904412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:18.920772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:18.940087 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:18.941205 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:18.942118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:18.943552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:18.946547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:18.948735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:18.959763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2c79b8ec-d899-44e1-a70d-ff8c7eee30e9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.314537 Sep 02 21:23:18.964218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 31/59] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:23:16 2022] POST /compute/v2.1/servers => generated 400 bytes in 2321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:23:18.975745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:18.983808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:19.023831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:19.024274 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:19.029259 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:19.030275 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:19.030762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:19.031190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:19.741592 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:19.759169 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-92b3d40e-dc73-4438-a713-2200b549af80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.792772 Sep 02 21:23:19.762346 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 32/60] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:18 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:19.786637 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:19.787748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:19.807730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:19.807730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:19.808658 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:19.812180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:19.826510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:19.831361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-66501bde-9ecf-4a5d-834f-07f0e52fa9dd tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.951185 Sep 02 21:23:19.832847 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:19.833450 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:19.851931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 29/61] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:18 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:19.864286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-81e32d2b-8992-435b-bfbd-1a06c77f9c68 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:19.865900 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-81e32d2b-8992-435b-bfbd-1a06c77f9c68 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:20.122569 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-81e32d2b-8992-435b-bfbd-1a06c77f9c68 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:20.159656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-81e32d2b-8992-435b-bfbd-1a06c77f9c68 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1237 microversion: 2.1 time: 0.321727 Sep 02 21:23:20.160375 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 30/62] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:19 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1237 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:20.279070 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:20.284480 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:20.288686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:20.291818 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-814f1443-f1af-4e2c-bb27-b89d484a9a25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1286 microversion: 2.20 time: 0.527489 Sep 02 21:23:20.293275 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 33/63] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:19 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1286 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:20.799407 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:20.804510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:20.819529 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:20.821085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:20.822532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:20.823689 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:20.824446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:20.825878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:20.871448 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:20.872327 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:20.884128 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:20.891868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:20.906012 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:20.907650 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:20.912952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:20.913583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:21.387740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:21.394466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:21.398749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c4ecbdd4-5397-4088-812a-e9c2bf4b6a25 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.533514 Sep 02 21:23:21.400198 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 34/64] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:20 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:21.411235 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1e442b83-0df1-43d1-a56a-75a708eb7077 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.618765 Sep 02 21:23:21.426648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 31/65] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:20 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:21.430257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-334283e4-e479-45ef-bfc3-329c3f73bcbf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:21.434200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-334283e4-e479-45ef-bfc3-329c3f73bcbf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:21.439905 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:21.441994 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:21.455409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:21.455807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:21.456239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:21.458247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:21.464525 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:21.465269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:21.602875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-334283e4-e479-45ef-bfc3-329c3f73bcbf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:21.606893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:21.613971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-334283e4-e479-45ef-bfc3-329c3f73bcbf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1237 microversion: 2.1 time: 0.211293 Sep 02 21:23:21.615183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 35/66] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:21 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1237 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:21.627162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:21.634299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:21.652255 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b87db42b-796f-4f09-a966-8c2b661b2b7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1334 microversion: 2.20 time: 0.210726 Sep 02 21:23:21.652255 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 32/67] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:21 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1334 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:21.833983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-52eff477-0313-46a0-90d5-e0f04a038375 req-48c5b413-b31e-4c39-a115-27abf7cd46b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8b3ea43-6b55-4349-8138-5503976ddeb2", "tag": "020c4c59-47d4-4b7e-8344-93353874fe13"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:21.856631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-52eff477-0313-46a0-90d5-e0f04a038375 req-48c5b413-b31e-4c39-a115-27abf7cd46b5 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:21.857134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-52eff477-0313-46a0-90d5-e0f04a038375 req-48c5b413-b31e-4c39-a115-27abf7cd46b5 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:21.857574 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-52eff477-0313-46a0-90d5-e0f04a038375 req-48c5b413-b31e-4c39-a115-27abf7cd46b5 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:21.912168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-52eff477-0313-46a0-90d5-e0f04a038375 req-48c5b413-b31e-4c39-a115-27abf7cd46b5 service nova] Creating event network-changed:020c4c59-47d4-4b7e-8344-93353874fe13 for instance f8b3ea43-6b55-4349-8138-5503976ddeb2 on hv-cinder-85220 Sep 02 21:23:21.923393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-52eff477-0313-46a0-90d5-e0f04a038375 req-48c5b413-b31e-4c39-a115-27abf7cd46b5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092113 Sep 02 21:23:21.923393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 36/68] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:22.443143 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:22.444218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:22.444733 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:22.444935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:22.453088 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:22.453950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:22.454792 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:22.455775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:22.456093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:22.456584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:22.456878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:22.457000 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:22.457695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:22.457914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:22.458179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:22.458598 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:22.744280 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:22.744421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:22.754991 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ce1b4ac6-999e-4440-9690-a412f0c14382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.316045 Sep 02 21:23:22.756135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-23b5ac3b-c8e0-4dcf-ae9f-0cac3cfc69ae tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.317142 Sep 02 21:23:22.757377 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 37/69] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:22 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:22.772469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:22.773105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:22.774133 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 33/70] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:22 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:22.786428 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:22.787154 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:22.788513 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:22.788640 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:22.789215 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:22.789685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:22.790317 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:22.791583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:22.805259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:22.806236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:22.808444 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:22.809740 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:22.810559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:22.811265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:22.902476 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:22.915124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0cbc1fe9-d6f4-4e42-b1cc-74e9c544c117 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1241 microversion: 2.1 time: 0.156039 Sep 02 21:23:22.917641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 38/71] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:22 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:22.941726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:22.954359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:22.954359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:22.955579 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3ff85b70-44d2-4304-85aa-bc9c1ad0d26c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1334 microversion: 2.20 time: 0.180263 Sep 02 21:23:22.956067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 34/72] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:22 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1334 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:23.417659 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2773cb90-2ca5-4840-9aa1-4f21cafb0862 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Action: 'create', calling method: .version_select at 0x7fb00d84d8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1722989288", "metadata": {"Type": "work"}}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2773cb90-2ca5-4840-9aa1-4f21cafb0862 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Request method failure captured: Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 122 Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnRLOD3AiJm-Fsqd7d-i40BDYmzvtfY9SGzn71RlPHwpEH0f90SyGp-aF2T8Laj0Yxe1s-ybJ0qfJCyoSfDq2g0C0rpaJcyd3EAoE2pu2J7tVsy7VmllGsAW7s_uIWO02W3sDuc71Uhe72ixfTR2xRB7S6K_jPofVACH-7-osUbNR-4 Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:23:23.423125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}] Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e17b6593ad20491fad65320c3b8636a2 Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1722989288", "metadata": {"Type": "work"}}} Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: Sep 02 21:23:23.424379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1722989288', 'metadata': {'Type': 'work'}}}} Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise error Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi '#$%' Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:23:23.425185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 21:23:23.426380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 21:23:23.427410 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 02 21:23:23.427410 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.430166 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2773cb90-2ca5-4840-9aa1-4f21cafb0862 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:23:23.431348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2773cb90-2ca5-4840-9aa1-4f21cafb0862 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.196467 Sep 02 21:23:23.432179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 39/73] 10.222.0.79 () {60 vars in 1156 bytes} [Fri Sep 2 21:23:23 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:23:23.442386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3c91e233-12b9-4ae2-98d4-e89e9eabf1f4 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Action: 'create', calling method: .version_select at 0x7fb00d0e0040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-324444581", "metadata": {"Type": "work"}}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3c91e233-12b9-4ae2-98d4-e89e9eabf1f4 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Request method failure captured: Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 119 Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnRLOD3AiJm-Fsqd7d-i40BDYmzvtfY9SGzn71RlPHwpEH0f90SyGp-aF2T8Laj0Yxe1s-ybJ0qfJCyoSfDq2g0C0rpaJcyd3EAoE2pu2J7tVsy7VmllGsAW7s_uIWO02W3sDuc71Uhe72ixfTR2xRB7S6K_jPofVACH-7-osUbNR-4 Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:23:23.448842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}] Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e17b6593ad20491fad65320c3b8636a2 Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-324444581", "metadata": {"Type": "work"}}} Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: Sep 02 21:23:23.450496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-324444581', 'metadata': {'Type': 'work'}}}} Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise error Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi '0' Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:23:23.451688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 21:23:23.452829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 21:23:23.453847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 02 21:23:23.453847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.453847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3c91e233-12b9-4ae2-98d4-e89e9eabf1f4 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:23:23.453847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3c91e233-12b9-4ae2-98d4-e89e9eabf1f4 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012264 Sep 02 21:23:23.453847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 35/74] 10.222.0.79 () {60 vars in 1156 bytes} [Fri Sep 2 21:23:23 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:23:23.461569 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-dbc28b02-f9a1-4a30-a443-d06dbbb98402 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Action: 'create', calling method: .version_select at 0x7fb00d861ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-62126492", "metadata": {"Type": "work"}}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-dbc28b02-f9a1-4a30-a443-d06dbbb98402 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Request method failure captured: Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 117 Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnRLOD3AiJm-Fsqd7d-i40BDYmzvtfY9SGzn71RlPHwpEH0f90SyGp-aF2T8Laj0Yxe1s-ybJ0qfJCyoSfDq2g0C0rpaJcyd3EAoE2pu2J7tVsy7VmllGsAW7s_uIWO02W3sDuc71Uhe72ixfTR2xRB7S6K_jPofVACH-7-osUbNR-4 Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:23:23.466597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}] Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e17b6593ad20491fad65320c3b8636a2 Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-62126492", "metadata": {"Type": "work"}}} Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: Sep 02 21:23:23.468978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-62126492', 'metadata': {'Type': 'work'}}}} Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise error Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi '' Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:23:23.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 02 21:23:23.471679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 02 21:23:23.473185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 02 21:23:23.473185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.473185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-dbc28b02-f9a1-4a30-a443-d06dbbb98402 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:23:23.473185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-dbc28b02-f9a1-4a30-a443-d06dbbb98402 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010937 Sep 02 21:23:23.473185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 40/75] 10.222.0.79 () {60 vars in 1156 bytes} [Fri Sep 2 21:23:23 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:23:23.477926 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5d442a7f-7980-4547-93be-fb13692de6c6 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Calling method '.version_select at 0x7fb00d06ea60>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:23.512493 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-5d442a7f-7980-4547-93be-fb13692de6c6 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] HTTP exception thrown: Volume tempest-invalid-1541367234 could not be found. Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5d442a7f-7980-4547-93be-fb13692de6c6 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Request method failure captured: Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1541367234 HTTP/1.1 Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnRLOD3AiJm-Fsqd7d-i40BDYmzvtfY9SGzn71RlPHwpEH0f90SyGp-aF2T8Laj0Yxe1s-ybJ0qfJCyoSfDq2g0C0rpaJcyd3EAoE2pu2J7tVsy7VmllGsAW7s_uIWO02W3sDuc71Uhe72ixfTR2xRB7S6K_jPofVACH-7-osUbNR-4 Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:23:23.516903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}] Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e17b6593ad20491fad65320c3b8636a2 Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Volume tempest-invalid-1541367234 could not be found. Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'tempest-invalid-1541367234'} Sep 02 21:23:23.518057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1541367234 could not be found. (HTTP 404) (Request-ID: req-2941dd84-4da6-445e-aaad-6971d277eedd) Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.518753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:23:23.520489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1541367234 could not be found. Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:23:23.522594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1541367234 could not be found. Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1541367234 could not be found. Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5d442a7f-7980-4547-93be-fb13692de6c6 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Returning 404 to user: Volume tempest-invalid-1541367234 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5d442a7f-7980-4547-93be-fb13692de6c6 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1541367234" status: 404 len: 99 microversion: 2.1 time: 0.044483 Sep 02 21:23:23.524672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 36/76] 10.222.0.79 () {58 vars in 1218 bytes} [Fri Sep 2 21:23:23 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1541367234 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 02 21:23:23.529103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2c9376e2-73ec-4238-b105-6d937c1c5eab tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004237 Sep 02 21:23:23.529871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 41/77] 10.222.0.79 () {58 vars in 1140 bytes} [Fri Sep 2 21:23:23 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 02 21:23:23.552247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2ed2a6b2-0fed-4269-b352-c650c5977855 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004176 Sep 02 21:23:23.552999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 37/78] 10.222.0.79 () {58 vars in 1137 bytes} [Fri Sep 2 21:23:23 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 02 21:23:23.564114 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1b1ee065-5d16-4ef9-b2c3-c91765e4b00a tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Calling method '.version_select at 0x7fb00d84db80>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:23.615622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-1b1ee065-5d16-4ef9-b2c3-c91765e4b00a tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] HTTP exception thrown: Volume 66c562a1-568e-41e9-a983-6a048d0a0727 could not be found. Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1b1ee065-5d16-4ef9-b2c3-c91765e4b00a tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Request method failure captured: Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/os-volumes/66c562a1-568e-41e9-a983-6a048d0a0727 HTTP/1.1 Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnRLOD3AiJm-Fsqd7d-i40BDYmzvtfY9SGzn71RlPHwpEH0f90SyGp-aF2T8Laj0Yxe1s-ybJ0qfJCyoSfDq2g0C0rpaJcyd3EAoE2pu2J7tVsy7VmllGsAW7s_uIWO02W3sDuc71Uhe72ixfTR2xRB7S6K_jPofVACH-7-osUbNR-4 Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:23:23.618192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}] Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e17b6593ad20491fad65320c3b8636a2 Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Volume 66c562a1-568e-41e9-a983-6a048d0a0727 could not be found. Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '66c562a1-568e-41e9-a983-6a048d0a0727'} Sep 02 21:23:23.622976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 66c562a1-568e-41e9-a983-6a048d0a0727 could not be found. (HTTP 404) (Request-ID: req-3381f2e2-5130-46d3-903a-8ad76534ae4d) Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.623769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 02 21:23:23.625406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 66c562a1-568e-41e9-a983-6a048d0a0727 could not be found. Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 02 21:23:23.626409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 66c562a1-568e-41e9-a983-6a048d0a0727 could not be found. Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 66c562a1-568e-41e9-a983-6a048d0a0727 could not be found. Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1b1ee065-5d16-4ef9-b2c3-c91765e4b00a tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Returning 404 to user: Volume 66c562a1-568e-41e9-a983-6a048d0a0727 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1b1ee065-5d16-4ef9-b2c3-c91765e4b00a tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/66c562a1-568e-41e9-a983-6a048d0a0727" status: 404 len: 109 microversion: 2.1 time: 0.061467 Sep 02 21:23:23.627353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 42/79] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:23:23 2022] DELETE /compute/v2.1/os-volumes/66c562a1-568e-41e9-a983-6a048d0a0727 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:23:23.632090 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6c408273-e695-4761-9c2a-d1618e70c576 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Calling method '.version_select at 0x7fb00d0e0dc0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:23.669727 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-6c408273-e695-4761-9c2a-d1618e70c576 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] HTTP exception thrown: Volume 08123cfc-16dd-4316-8b28-61bc6d6a7af5 could not be found. Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6c408273-e695-4761-9c2a-d1618e70c576 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Request method failure captured: Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/os-volumes/08123cfc-16dd-4316-8b28-61bc6d6a7af5 HTTP/1.1 Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnRLOD3AiJm-Fsqd7d-i40BDYmzvtfY9SGzn71RlPHwpEH0f90SyGp-aF2T8Laj0Yxe1s-ybJ0qfJCyoSfDq2g0C0rpaJcyd3EAoE2pu2J7tVsy7VmllGsAW7s_uIWO02W3sDuc71Uhe72ixfTR2xRB7S6K_jPofVACH-7-osUbNR-4 Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:23:23.673988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/945be97c1d2540eea02f1a4065bb94a5"}]}] Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 945be97c1d2540eea02f1a4065bb94a5 Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-VolumesNegativeTest-610177613 Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e17b6593ad20491fad65320c3b8636a2 Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-VolumesNegativeTest-610177613-project Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Volume 08123cfc-16dd-4316-8b28-61bc6d6a7af5 could not be found. Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '08123cfc-16dd-4316-8b28-61bc6d6a7af5'} Sep 02 21:23:23.676234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 08123cfc-16dd-4316-8b28-61bc6d6a7af5 could not be found. (HTTP 404) (Request-ID: req-d5d89f3b-d591-457b-b26d-4c1f828db254) Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.677429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:23:23.678648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 08123cfc-16dd-4316-8b28-61bc6d6a7af5 could not be found. Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 21:23:23.679944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 08123cfc-16dd-4316-8b28-61bc6d6a7af5 could not be found. Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 08123cfc-16dd-4316-8b28-61bc6d6a7af5 could not be found. Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:23:23.681877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6c408273-e695-4761-9c2a-d1618e70c576 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] Returning 404 to user: Volume 08123cfc-16dd-4316-8b28-61bc6d6a7af5 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:23:23.683105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6c408273-e695-4761-9c2a-d1618e70c576 tempest-VolumesNegativeTest-610177613 tempest-VolumesNegativeTest-610177613-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/08123cfc-16dd-4316-8b28-61bc6d6a7af5" status: 404 len: 109 microversion: 2.1 time: 0.050882 Sep 02 21:23:23.685969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 38/80] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:23:23 2022] GET /compute/v2.1/os-volumes/08123cfc-16dd-4316-8b28-61bc6d6a7af5 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:23:23.802424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:23.803121 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:23.805641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:23.806790 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:23.807378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:23.810375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:23.810863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:23.811297 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:23.811990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:23.812445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:23.813188 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:23.813773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:23.814292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:23.814732 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:23.815434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:23.815880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:23.816320 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:24.223815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:24.252277 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-01512b5d-7650-446a-ae2e-f7ba5f897ba3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.448237 Sep 02 21:23:24.255943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 39/81] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:23 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:24.279703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:24.280996 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:24.295207 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:24.296005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:24.296914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:24.298124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:24.299068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:24.299789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:24.315242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:24.320042 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=99 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:24.349129 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c7abfff9-04a3-4cfa-af83-53c9db22847a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.543067 Sep 02 21:23:24.350210 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 43/82] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:23 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:24.382843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:24.383754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:24.409148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:24.416983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:24.418092 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:24.419607 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:24.420660 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:24.421682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:24.569187 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:24.583569 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4fb201ac-ab7a-4214-ac94-529900ffa440 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1233 microversion: 2.1 time: 0.324503 Sep 02 21:23:24.587983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 40/83] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:24 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1233 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:24.614100 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:24.633379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:24.644966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:24.652652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-56b0ef80-7b3d-4fb2-8f35-0034e1ce05f8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1334 microversion: 2.20 time: 0.288100 Sep 02 21:23:24.656118 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 44/84] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:24 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1334 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:25.282780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:25.283481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:25.289980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:25.290582 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:25.291119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:25.291922 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:25.292567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:25.293057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:25.387294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:25.387965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:25.395106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:25.395592 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:25.396109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:25.396729 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:25.397192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:25.397612 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:25.705465 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:25.716754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3fb24e5b-af88-4b94-b082-ee6d35b6eacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.439284 Sep 02 21:23:25.717924 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 41/85] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:25 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:25.728342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:25.729341 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:25.739657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:25.740463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:25.741054 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:25.744897 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:25.745517 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:25.746172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:25.819501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:25.825554 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-69fc812e-a792-4f91-8749-08806d9be73b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.443127 Sep 02 21:23:25.826574 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 45/86] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:25 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:25.836554 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:25.837221 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:25.845989 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:25.846688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:25.850050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:25.850501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:25.851504 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:25.852069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:25.852510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:25.859936 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-de74d861-804a-48c5-a6a5-1b497be11ca0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1289 microversion: 2.1 time: 0.140402 Sep 02 21:23:25.861690 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 42/87] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:25 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1289 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:25.938976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:25.947968 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:25.949537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:25.953669 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d18223bf-1e00-4f5c-95d2-2022a692de77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1340 microversion: 2.20 time: 0.123441 Sep 02 21:23:25.953669 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 46/88] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:25 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1340 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:27.011259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:27.011259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:27.011259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:27.011259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:27.011856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:27.011856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:27.011856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:27.011856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:27.012150 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:27.012150 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:27.012150 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:27.012150 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:27.012712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:27.012712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:27.012712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:27.012712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:27.012954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:27.012954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f2ca864a-b54a-4f7d-8f02-e29f6f9cc882 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.177598 Sep 02 21:23:27.012954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 43/89] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:26 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:27.012954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:27.013222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:27.013222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:27.013222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:27.013222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:27.013475 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:27.013475 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:27.013475 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:27.013658 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:27.020143 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-82d5302f-71a9-4b60-aefe-d2aed2f7d58f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1297 microversion: 2.1 time: 0.099836 Sep 02 21:23:27.020716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 44/90] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:26 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:27.026086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:27.027545 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:27.033141 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:27.033622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:27.034086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:27.035299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:27.035622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:27.035770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:27.044245 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:27.052181 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c66781ce-8ea3-4b98-9204-db7638a667bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.205518 Sep 02 21:23:27.052747 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 47/91] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:26 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:27.099778 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:27.108405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:27.109905 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:27.111021 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7fa9f1af-39f3-49a0-a0ce-0e40e30dc798 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1340 microversion: 2.20 time: 0.089386 Sep 02 21:23:27.111581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 45/92] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:27 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1340 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:28.024318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:28.024873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:28.031378 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:28.031869 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:28.032299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:28.033021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:28.033646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:28.034397 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:28.045097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:28.045978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:28.052662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:28.053145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:28.053588 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:28.054327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:28.054786 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:28.055211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:28.154353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:28.187763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-58cfc199-7f14-4315-aa74-50c698e57f87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1297 microversion: 2.1 time: 0.147075 Sep 02 21:23:28.210841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 46/93] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:28 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1297 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:28.221066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:28.222130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:28.230000 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:28.230833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:28.232402 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:28.233288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:28.233937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:28.234540 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:28.498389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:28.549371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-58823ffc-b7be-4aaf-bc6e-37e43d61b30f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.528777 Sep 02 21:23:28.551552 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 48/94] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:28 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:28.567306 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:28.571571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:28.587762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:28.593558 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:28.600900 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-71730d2f-3f35-4a78-a765-7ee6756add18 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.384675 Sep 02 21:23:28.600900 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 47/95] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:28 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:28.601296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:28.601296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:28.601296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:28.601296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:28.601845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:28.656427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=4 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:28.986140 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:29.006809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:29.009929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:29.012330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9d40cec5-7a8a-456e-a638-092bbfad063c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.453988 Sep 02 21:23:29.015355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 49/96] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:28 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:29.220624 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:29.222862 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:29.235372 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=4 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:29.242622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:29.243313 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:29.244009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:29.244880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:29.248318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:29.249234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:29.574174 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:29.575951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:29.587889 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:29.593088 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:29.593303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:29.593615 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:29.596664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:29.600254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:29.600851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:29.605844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-724c7cba-6960-444e-8591-29bd7248976f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.393665 Sep 02 21:23:29.607881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 48/97] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:29 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:29.637001 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:29.637951 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:29.650826 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:29.652342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:29.652877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:29.658886 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:29.659386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:29.659827 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:29.883335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:29.894015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3e8f2bee-1c5a-4b18-9379-91b630f92a9c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.323823 Sep 02 21:23:29.896109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 50/98] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:29 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:29.906706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:29.909225 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:29.916943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-88614526-b6ca-4f94-ac47-08787b7f999b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.284965 Sep 02 21:23:29.919328 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 49/99] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:29 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:30.041582 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:30.041582 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:30.051890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:30.052535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:30.053233 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:30.054154 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:30.054768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:30.055351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:30.293483 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:30.318957 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:30.324499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:30.326940 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-74ccc9e7-1ab0-4a4e-9af2-e0f5ba174e65 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.289829 Sep 02 21:23:30.328485 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 51/100] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:30 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:30.513676 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-9c841af6-baf6-474c-93f5-76cf3aed77f6 req-b5e35539-cd70-4934-9a3b-43deacf3faa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5852d6-c6ee-489d-a2cd-a1ce7008540f", "tag": "9c460ac1-1f81-408f-907d-b19a443be414"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:30.570198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=8 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:30.589459 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-9c841af6-baf6-474c-93f5-76cf3aed77f6 req-b5e35539-cd70-4934-9a3b-43deacf3faa3 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:30.596207 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-9c841af6-baf6-474c-93f5-76cf3aed77f6 req-b5e35539-cd70-4934-9a3b-43deacf3faa3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:30.596802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-9c841af6-baf6-474c-93f5-76cf3aed77f6 req-b5e35539-cd70-4934-9a3b-43deacf3faa3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:30.626219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-9c841af6-baf6-474c-93f5-76cf3aed77f6 req-b5e35539-cd70-4934-9a3b-43deacf3faa3 service nova] Creating event network-changed:9c460ac1-1f81-408f-907d-b19a443be414 for instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f on hv-cinder-85220 Sep 02 21:23:30.637543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:30.638387 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:30.662061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-9c841af6-baf6-474c-93f5-76cf3aed77f6 req-b5e35539-cd70-4934-9a3b-43deacf3faa3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141986 Sep 02 21:23:30.662061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 50/101] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:30.662380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:30.662380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:30.662380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:30.671206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-eb5570b9-53f4-4ab6-ae6e-0f1fc64d3240 req-7d4a8509-5533-4f88-9814-4214eb4ef0d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c79e24-443d-42bb-baa0-e9da52325154", "tag": "6f431917-787d-4d70-8710-69f6656d5ead"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:30.672587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:30.673718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:30.679398 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:30.699550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-eb5570b9-53f4-4ab6-ae6e-0f1fc64d3240 req-7d4a8509-5533-4f88-9814-4214eb4ef0d9 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:30.703412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-eb5570b9-53f4-4ab6-ae6e-0f1fc64d3240 req-7d4a8509-5533-4f88-9814-4214eb4ef0d9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:30.704605 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-eb5570b9-53f4-4ab6-ae6e-0f1fc64d3240 req-7d4a8509-5533-4f88-9814-4214eb4ef0d9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:30.766504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-eb5570b9-53f4-4ab6-ae6e-0f1fc64d3240 req-7d4a8509-5533-4f88-9814-4214eb4ef0d9 service nova] Creating event network-changed:6f431917-787d-4d70-8710-69f6656d5ead for instance c0c79e24-443d-42bb-baa0-e9da52325154 on hv-cinder-85220 Sep 02 21:23:30.781724 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-eb5570b9-53f4-4ab6-ae6e-0f1fc64d3240 req-7d4a8509-5533-4f88-9814-4214eb4ef0d9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122275 Sep 02 21:23:30.783959 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 51/102] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:30.919278 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:30.920312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:30.931306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:30.934559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:30.936562 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:30.937497 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:30.939977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:30.947032 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:31.499502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:31.516405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ed33b605-edf8-4b37-a5a6-4703ee022dcf tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.594479 Sep 02 21:23:31.516405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 52/103] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:30 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:31.526493 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:31.527376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:31.542102 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:31.543495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:31.544776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:31.545877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:31.546543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:31.547255 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:31.596348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:31.610105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-62e35019-4fc2-466c-a31c-cad9e64ff794 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.979841 Sep 02 21:23:31.610963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 52/104] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:30 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:31.622885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:31.623796 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:31.625953 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=8 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:31.637696 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:31.638464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:31.638653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:31.642695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:31.643400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:31.643746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:32.108759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:32.116794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:32.119106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8adf368b-7a2c-49ed-8d12-3386c038c445 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.603046 Sep 02 21:23:32.120225 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 53/105] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:31 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:32.139329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:32.145983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:32.147427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-daf32aaa-c4bf-48b3-8a3c-448d4b3ce4cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.535235 Sep 02 21:23:32.148203 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 53/106] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:31 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:32.247246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-47b1f89a-8bca-459c-be06-4dde0a454f7f req-6a3ff330-826a-4076-93c2-b2ae650ac657 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3610c813-9d2a-44e4-a9a5-5652a58fd962", "name": "network-vif-plugged", "status": "completed", "tag": "abe2a65b-088e-4c84-8bc9-00a0dfa258e3"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:32.275318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-47b1f89a-8bca-459c-be06-4dde0a454f7f req-6a3ff330-826a-4076-93c2-b2ae650ac657 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:32.276213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-47b1f89a-8bca-459c-be06-4dde0a454f7f req-6a3ff330-826a-4076-93c2-b2ae650ac657 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:32.277903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-47b1f89a-8bca-459c-be06-4dde0a454f7f req-6a3ff330-826a-4076-93c2-b2ae650ac657 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:32.292553 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-47b1f89a-8bca-459c-be06-4dde0a454f7f req-6a3ff330-826a-4076-93c2-b2ae650ac657 service nova] Creating event network-vif-plugged:abe2a65b-088e-4c84-8bc9-00a0dfa258e3 for instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 on hv-cinder-85220 Sep 02 21:23:32.297908 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-47b1f89a-8bca-459c-be06-4dde0a454f7f req-6a3ff330-826a-4076-93c2-b2ae650ac657 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176201 Sep 02 21:23:32.298504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 54/107] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:32.540735 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:32.541605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:32.548316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:32.549231 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:32.549959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:32.550967 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:32.552794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:32.552794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:32.638047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:32.639836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:32.647196 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:32.648327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:32.649116 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:32.650150 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:32.650850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:32.652511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:33.306457 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:33.321169 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:33.328896 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-67d3c95f-a68f-4d67-834d-b8d9321d2eb4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.790618 Sep 02 21:23:33.333918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 54/108] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:32 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:33.335878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:33.336742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:33.343484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-aa4301ba-a98d-4a37-9147-d04874761770 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.710330 Sep 02 21:23:33.346170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 55/109] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:32 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:33.357756 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:33.358127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:33.358604 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:33.359543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:33.360573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:33.360711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:33.361453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:33.362017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:33.372370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:33.372370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:33.372370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:33.372370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:33.373393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:33.373393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:33.638179 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:33.654858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:33.656359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:33.660854 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-68befdfc-2a20-49de-8a78-f81518fc2e8c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.312187 Sep 02 21:23:33.662758 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 56/110] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:33 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:33.677462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:33.693206 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ef160a76-dbbe-4d5e-b2f3-35692918c0d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.362081 Sep 02 21:23:33.706314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 55/111] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:33 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:34.315915 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-7e0898ca-7926-4047-812f-f72d8ccb36fd req-ca342b92-7651-45b0-946b-1ca91cfa2821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cd645d-2c7b-4d0e-889b-2a84f911b5d2", "name": "network-vif-plugged", "status": "completed", "tag": "22e52286-ac23-4daa-89c9-c5ad908c745a"}, {"server_uuid": "f8b3ea43-6b55-4349-8138-5503976ddeb2", "name": "network-vif-plugged", "status": "completed", "tag": "020c4c59-47d4-4b7e-8344-93353874fe13"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:34.328194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-7e0898ca-7926-4047-812f-f72d8ccb36fd req-ca342b92-7651-45b0-946b-1ca91cfa2821 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.330788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-7e0898ca-7926-4047-812f-f72d8ccb36fd req-ca342b92-7651-45b0-946b-1ca91cfa2821 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.330788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-7e0898ca-7926-4047-812f-f72d8ccb36fd req-ca342b92-7651-45b0-946b-1ca91cfa2821 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.347977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-7e0898ca-7926-4047-812f-f72d8ccb36fd req-ca342b92-7651-45b0-946b-1ca91cfa2821 service nova] Creating event network-vif-plugged:22e52286-ac23-4daa-89c9-c5ad908c745a for instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 on hv-cinder-85220 Sep 02 21:23:34.348487 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-7e0898ca-7926-4047-812f-f72d8ccb36fd req-ca342b92-7651-45b0-946b-1ca91cfa2821 service nova] Creating event network-vif-plugged:020c4c59-47d4-4b7e-8344-93353874fe13 for instance f8b3ea43-6b55-4349-8138-5503976ddeb2 on hv-cinder-85220 Sep 02 21:23:34.355210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-7e0898ca-7926-4047-812f-f72d8ccb36fd req-ca342b92-7651-45b0-946b-1ca91cfa2821 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043641 Sep 02 21:23:34.355809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 57/112] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:34.366512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:34.366512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:34.366512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.366512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.367710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.367805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.368532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.369068 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.370828 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:34.372081 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:34.379656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.380145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.380825 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.382560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.383869 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.384360 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.701961 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:34.706447 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:34.718973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0c48b939-57ec-4045-a8d0-ecf14d3bcb29 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.353828 Sep 02 21:23:34.719245 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8446a174-fa77-4b19-ab82-fd56103f34b3 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.367259 Sep 02 21:23:34.719560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 58/113] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:34 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:34.720183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 56/114] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:34 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:34.725156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:34.726006 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:34.733434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.734199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.734796 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.735665 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.736327 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.736916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.747755 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:34.748883 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:34.756318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.757224 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.757898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.758801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:34.759314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:34.759805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:34.962473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:34.972426 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8f7c3196-aaa2-4e46-b7bc-5f16bc599905 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.251071 Sep 02 21:23:34.973566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 57/115] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:34 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:34.977413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:34.988792 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:34.990673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:34.992178 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d6c72439-67a2-4199-8f4d-d035ee119d4a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.271670 Sep 02 21:23:34.992880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 59/116] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:34 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:35.754468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:35.754468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:35.760035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:35.761939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:35.775499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:35.776515 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:35.777676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:35.778563 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:35.779177 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:35.779377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:35.779923 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:35.780100 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:35.780691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:35.783599 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:35.784089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:35.785597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:36.072787 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:36.082285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-20940e40-529e-4daf-b7e0-e39d36e78aaf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.332576 Sep 02 21:23:36.093849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 58/117] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:35 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:36.094070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:36.094205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:36.094205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:36.095917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-89a70c16-20cc-449d-a726-369f4cc27aab tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.350611 Sep 02 21:23:36.096676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:36.096871 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 60/118] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:35 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:36.097382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:36.098080 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:36.099147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:36.099912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:36.103494 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:36.136987 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:36.136987 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:36.144897 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:36.145393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:36.146049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:36.146759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:36.147211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:36.147625 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:36.378316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:36.386880 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1c6f0b68-9741-43f0-bcfa-a640b169c3d7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.302352 Sep 02 21:23:36.388914 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 59/119] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:36 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:36.392983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:36.403020 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:36.404884 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:36.406082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6730c829-482b-49e2-8bc5-b36581fa45cf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.295482 Sep 02 21:23:36.406651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 61/120] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:36 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:37.111291 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:37.112089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:37.118811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:37.119270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:37.119710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:37.120425 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:37.120889 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:37.121542 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:37.130699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:37.131780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:37.140640 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:37.141267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:37.141382 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:37.142349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:37.143744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:37.144920 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:37.146094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:37.341383 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:37.369997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-eeebffa0-30a0-45a5-9b3e-120b6527d225 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.251097 Sep 02 21:23:37.369997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 60/121] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:37 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:37.370487 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:37.383679 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-231df346-2621-40a1-8872-102ff53da633 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.257867 Sep 02 21:23:37.385629 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 62/122] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:37 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:37.416538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:37.418794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:37.430510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:37.431333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:37.432054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:37.432386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:37.433189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:37.433308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:37.434076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:37.434781 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:37.441336 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:37.442085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:37.443044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:37.444388 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:37.445140 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:37.445862 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:37.716703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:37.727605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a2264f88-7526-41d8-b79f-20bfb7b7083b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.317500 Sep 02 21:23:37.728200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 61/123] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:37 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:37.761092 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:37.779259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:37.782260 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:37.783860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b421fca2-5651-46c5-812a-79e6377a5a10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.356667 Sep 02 21:23:37.784673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 63/124] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:37 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:23:38.410235 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:38.411017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:38.412735 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:38.414617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:38.417594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.418072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.418516 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.419995 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.420467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.425407 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.428949 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.429967 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.430656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.431775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.432516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.436444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.640580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:38.651966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:38.660812 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3b3271b0-6a4b-460d-b775-aeb0c747add6 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.254875 Sep 02 21:23:38.670735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 64/125] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:38 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:38.670949 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-264bb275-82b8-456e-ab9c-0e94850d3a44 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.264100 Sep 02 21:23:38.670949 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 62/126] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:38 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:38.767997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:38.768673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:38.775925 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.776796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.777469 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.778765 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.779416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.780021 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.811389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:38.812351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:38.819153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.819648 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.820093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:38.820811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:38.821263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:38.821692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:39.015372 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:39.024522 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-70af5be2-7eeb-45cf-bc78-d50b9e74f6e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.262152 Sep 02 21:23:39.031039 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 65/127] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:38 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:39.048393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:39.058038 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:39.060515 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:39.061677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-04b33a14-5795-48a9-b40c-e3fa22f2dd58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.254939 Sep 02 21:23:39.063240 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 63/128] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:38 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:23:39.703017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:39.704266 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:39.710146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:39.710860 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:39.717112 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:39.717601 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:39.718094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:39.718877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:39.719332 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:39.719764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:39.723743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:39.724744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:39.725847 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:39.730188 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:39.730188 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:39.730188 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:39.960099 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:39.968809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9586931c-7d34-4193-864c-5c5a871858df tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.275957 Sep 02 21:23:39.968986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:39.969393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 66/129] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:39 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:39.977680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d3742798-3ce4-4b43-9449-d33e758d5a61 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.279141 Sep 02 21:23:39.978405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 64/130] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:39 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:40.053509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:40.054349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:40.089600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:40.089600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:40.089600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:40.089600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:40.092354 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:40.092354 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:40.103518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:40.108230 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:40.131559 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:40.131828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:40.132691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:40.133843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:40.134294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:40.134721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:40.389670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:40.400801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5944b3c9-cd93-4066-8e44-e25556abc286 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.353067 Sep 02 21:23:40.403944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 67/131] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:40 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:40.416478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:40.427227 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:40.432943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:40.433173 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9d0fb1f6-c272-4414-b8fa-5c66a3ba1c91 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.339747 Sep 02 21:23:40.434078 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 65/132] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:40 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:40.992997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:40.993607 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:41.000910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:41.001420 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:41.001881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:41.002881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:41.003144 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:41.003609 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:41.003718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:41.003815 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:41.009828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:41.010546 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:41.010996 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:41.015454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:41.015454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:41.015454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:41.264566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:41.271519 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:41.288340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3e3a0d1a-4f9e-4dcc-9319-96275c7cff88 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.288246 Sep 02 21:23:41.292310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 66/133] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:40 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:41.304190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-39e2b6b6-839b-4746-87c2-18cade88c529 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1315 microversion: 2.1 time: 0.314550 Sep 02 21:23:41.309043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 68/134] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:40 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:41.429835 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:41.430458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:41.437831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:41.438326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:41.438763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:41.439465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:41.439924 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:41.440345 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:41.462973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:41.465435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:41.474865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:41.475721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:41.476368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:41.477291 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:41.478100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:41.479273 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:41.485288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:41.709377 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:41.737334 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-940c553a-988b-4af3-b923-df6ce1b1f32f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.294648 Sep 02 21:23:41.737334 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 67/135] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:41 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:41.740288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:41.749767 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:41.751618 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:41.752803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0ea54864-10d5-4c99-a712-bb9028f6005c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.295529 Sep 02 21:23:41.759091 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 69/136] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:41 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:42.343349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:42.344009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:42.344916 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:42.346247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:42.352292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.353053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.353623 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.354682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.355704 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.356703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.357221 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.358050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.358610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.359032 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.365136 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.367859 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.576044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:42.579536 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:42.585115 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b1478056-f0da-4ead-91e7-c7d47f50cacc tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1503 microversion: 2.1 time: 0.247142 Sep 02 21:23:42.585696 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 70/137] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:42 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:42.593739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bdecfbe9-fd2a-4280-a55c-0613537112dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.262413 Sep 02 21:23:42.602127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-1d0e1bc9-be12-4800-9bec-66de1423608e req-dd71060b-3407-4979-b653-4d0c2aa59f67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5852d6-c6ee-489d-a2cd-a1ce7008540f", "name": "network-vif-plugged", "status": "completed", "tag": "9c460ac1-1f81-408f-907d-b19a443be414"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:42.602815 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 68/138] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:42 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:42.616880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1d0e1bc9-be12-4800-9bec-66de1423608e req-dd71060b-3407-4979-b653-4d0c2aa59f67 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.617369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1d0e1bc9-be12-4800-9bec-66de1423608e req-dd71060b-3407-4979-b653-4d0c2aa59f67 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.617802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1d0e1bc9-be12-4800-9bec-66de1423608e req-dd71060b-3407-4979-b653-4d0c2aa59f67 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.630238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-1d0e1bc9-be12-4800-9bec-66de1423608e req-dd71060b-3407-4979-b653-4d0c2aa59f67 service nova] Creating event network-vif-plugged:9c460ac1-1f81-408f-907d-b19a443be414 for instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f on hv-cinder-85220 Sep 02 21:23:42.635944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-1d0e1bc9-be12-4800-9bec-66de1423608e req-dd71060b-3407-4979-b653-4d0c2aa59f67 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042099 Sep 02 21:23:42.637316 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 71/139] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:42.744875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:42.746878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:42.754209 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.754929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.755751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.756668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.757271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.758486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.791350 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:42.793882 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:42.804536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.805423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.806124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.806933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:42.807462 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:42.807957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:42.951668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:42.959840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7366a03d-cf43-4ff4-8b93-1510bb87f5d3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1322 microversion: 2.1 time: 0.219197 Sep 02 21:23:42.960768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 69/140] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:42 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:42.988378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:42.998051 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:42.999531 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:43.000774 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-32e2a18a-7a8e-4eec-a979-5de025351b02 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.222039 Sep 02 21:23:43.004865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 72/141] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:42 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:23:43.623376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:43.624727 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:43.633947 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:43.634460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:43.634974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:43.635884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:43.636955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:43.637461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:43.797580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:43.807608 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-89fb899f-46cc-48f6-a10b-e0a2fb7a9266 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.191349 Sep 02 21:23:43.808201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 70/142] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:43 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:43.984811 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:43.985637 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:43.992323 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:43.992672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:43.993170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:43.993916 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:43.994437 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:43.994860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:44.035585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:44.036638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:44.046784 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:44.047732 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:44.048530 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:44.049349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:44.050088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:44.050723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:44.286523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:44.300689 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-398d0a3e-76d5-40e1-bd10-cbfd0a4de4d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1516 microversion: 2.1 time: 0.320173 Sep 02 21:23:44.302572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 73/143] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:43 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1516 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:44.335886 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:44.343096 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:44.347351 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:44.350532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:44.351009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:44.353733 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:44.359602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:44.360752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:44.365339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:44.365339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:44.365339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:44.365339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:44.367138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9cfc5d5e-3068-4073-bb79-c7a492c90f16 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.338944 Sep 02 21:23:44.368115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 71/144] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:44 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:44.487921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lazy-loading 'flavor' on Instance uuid f8b3ea43-6b55-4349-8138-5503976ddeb2 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:23:44.662228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-5f481f18-9819-4024-8919-8535a698ef10 req-a087f389-242c-49b0-b40b-a493f373404c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c79e24-443d-42bb-baa0-e9da52325154", "name": "network-vif-plugged", "status": "completed", "tag": "6f431917-787d-4d70-8710-69f6656d5ead"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:44.696445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5f481f18-9819-4024-8919-8535a698ef10 req-a087f389-242c-49b0-b40b-a493f373404c service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:44.697378 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5f481f18-9819-4024-8919-8535a698ef10 req-a087f389-242c-49b0-b40b-a493f373404c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:44.699079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5f481f18-9819-4024-8919-8535a698ef10 req-a087f389-242c-49b0-b40b-a493f373404c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:44.717546 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-5f481f18-9819-4024-8919-8535a698ef10 req-a087f389-242c-49b0-b40b-a493f373404c service nova] Creating event network-vif-plugged:6f431917-787d-4d70-8710-69f6656d5ead for instance c0c79e24-443d-42bb-baa0-e9da52325154 on hv-cinder-85220 Sep 02 21:23:44.744661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-5f481f18-9819-4024-8919-8535a698ef10 req-a087f389-242c-49b0-b40b-a493f373404c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085195 Sep 02 21:23:44.744661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 72/145] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:23:44.836007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:44.836741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:44.849420 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:44.850485 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:44.851904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:44.854477 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:44.856008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:44.856942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:45.051352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:45.060007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9d7cfaeb-0ee0-4e72-9ac8-be3eddccbb93 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.228582 Sep 02 21:23:45.060595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 73/146] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:44 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:45.066166 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98d04e15-48df-4db1-90ef-51b64d739db1"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:45.068786 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:45.075803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:45.076283 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:45.076723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:45.077723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:45.078475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:45.079007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:45.219527 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2034abf3-e754-4cde-a180-5825f3a2b096 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2/action" status: 200 len: 32 microversion: 2.1 time: 0.884453 Sep 02 21:23:45.220240 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 74/147] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:23:44 2022] POST /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2/action => generated 32 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 21:23:45.233259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:45.234010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:45.241537 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:45.242066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:45.242515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:45.243234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:45.243687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:45.244107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:45.407247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:45.416486 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f58186f2-9180-4153-8b46-89496afe8929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.187730 Sep 02 21:23:45.417382 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 75/148] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:45 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:45.426065 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:45.426065 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:45.430823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:45.431292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:45.431726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:45.432426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:45.433009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:45.434453 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:45.598107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:45.610988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:45.616349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:45.618425 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4432d34f-c235-4c0f-bcc7-1389e6349597 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.199697 Sep 02 21:23:45.619662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 76/149] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:45 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:46.093520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:46.095489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:46.109715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:46.110497 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:46.111212 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:46.112123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:46.112770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:46.113396 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:46.304733 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:46.313256 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b4a787ae-5d72-4fc6-a21d-55ef0330d624 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.226861 Sep 02 21:23:46.313841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 77/150] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:46 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:46.443912 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:46.444641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:46.451765 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:46.452258 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:46.452711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:46.453445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:46.453932 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:46.454362 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:46.661509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:46.672574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a6a58f40-58ad-46ce-80db-1ed97cdb17e9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.232427 Sep 02 21:23:46.673323 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 78/151] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:46 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:46.678333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:46.679213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:46.692875 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:46.693626 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:46.694307 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:46.695239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:46.695663 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:46.696104 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:46.968982 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:46.978298 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:46.979761 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:46.981603 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-90f14478-2609-4428-98c0-206f5502b184 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1406 microversion: 2.20 time: 0.307294 Sep 02 21:23:46.982207 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 79/152] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:46 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:47.341897 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:47.342956 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:47.350216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:47.350622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:47.351238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:47.352283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:47.352763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:47.353160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:47.784685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:47.796912 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8423e20d-89d0-4172-a02b-2d93fd15b847 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.459068 Sep 02 21:23:47.797966 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 80/153] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:47 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:23:47.807553 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:47.808445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:47.819145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:47.820158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:47.823344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:47.823344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:47.823344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:47.823777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:48.029756 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-adf61b59-d280-406b-ab28-c25576e6d313 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "POST /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.967884 Sep 02 21:23:48.031428 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 74/154] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:23:45 2022] POST /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2/os-volume_attachments => generated 194 bytes in 2970 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:48.041987 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:48.043901 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:48.053027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:48.054186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:48.055155 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:48.056609 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:48.058030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:48.058938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:48.109201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:48.140732 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ed4c62c0-b853-4268-8bac-23a3c69232ee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.340696 Sep 02 21:23:48.142181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 81/155] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:47 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:48.437514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:48.448021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:48.450830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:48.452567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6bed069b-7d7b-418e-b915-08398f36cd51 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1598 microversion: 2.20 time: 0.419660 Sep 02 21:23:48.453148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 75/156] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:23:48 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1598 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:23:48.481596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:48.483087 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:48.490071 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:48.490879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:48.491765 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:48.492737 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:48.493355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:48.494024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:48.589099 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-991248a2-2b41-4962-b76d-dfa20459665c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111955 Sep 02 21:23:48.590261 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 82/157] 10.222.0.79 () {60 vars in 1316 bytes} [Fri Sep 2 21:23:48 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:23:48.831039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:48.832728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:48.848781 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:48.852104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:48.854104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:48.858083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:48.861399 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:48.862190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:48.916531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:49.159555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:49.176793 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:49.177731 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:49.181701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f4de8a44-9744-4f2c-9dc1-c722f02cd646 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1361 microversion: 2.1 time: 0.349785 Sep 02 21:23:49.184740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 76/158] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:48 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1361 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:49.209512 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:49.216157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:49.217077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:49.218203 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:49.220602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:49.221282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:49.624520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:49.637249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d5266583-a4e0-408c-bad6-ce51b3cc9df8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.464535 Sep 02 21:23:49.638329 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 83/159] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:49 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:50.213433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:50.215205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:50.224533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:50.225031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:50.225494 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:50.226240 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:50.226702 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:50.227127 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:50.429760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:50.440323 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-98ef571a-3a86-4668-9c3f-32c92a7a0330 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1546 microversion: 2.1 time: 0.231300 Sep 02 21:23:50.441365 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 77/160] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:50 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1546 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:50.488799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:50.489390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:50.496522 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:50.496893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:50.497415 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:50.498366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:50.498902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:50.499456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:50.633211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-37636c5d-a736-4b46-a0c6-41d410049274 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.148261 Sep 02 21:23:50.634338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 84/161] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Sep 2 21:23:50 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:23:50.664481 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:50.665422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:50.675264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:50.676079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:50.676823 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:50.681366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:50.681366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:50.681366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:51.152099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:51.169929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3b27cd5e-844d-4e0a-b863-07678faa3b66 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.507864 Sep 02 21:23:51.187137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 78/162] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:50 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:51.372910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-cfefc424-7305-4eb6-9ef3-4eb9b2e4afad req-0a2d8f0c-3454-4cbb-9084-cd6f8331a750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5852d6-c6ee-489d-a2cd-a1ce7008540f", "tag": "9c460ac1-1f81-408f-907d-b19a443be414"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:51.396487 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-cfefc424-7305-4eb6-9ef3-4eb9b2e4afad req-0a2d8f0c-3454-4cbb-9084-cd6f8331a750 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:51.397325 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-cfefc424-7305-4eb6-9ef3-4eb9b2e4afad req-0a2d8f0c-3454-4cbb-9084-cd6f8331a750 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:51.398305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-cfefc424-7305-4eb6-9ef3-4eb9b2e4afad req-0a2d8f0c-3454-4cbb-9084-cd6f8331a750 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:51.407503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:23:51.436993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-cfefc424-7305-4eb6-9ef3-4eb9b2e4afad req-0a2d8f0c-3454-4cbb-9084-cd6f8331a750 service nova] Creating event network-changed:9c460ac1-1f81-408f-907d-b19a443be414 for instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f on hv-cinder-85220 Sep 02 21:23:51.456618 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-cfefc424-7305-4eb6-9ef3-4eb9b2e4afad req-0a2d8f0c-3454-4cbb-9084-cd6f8331a750 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092206 Sep 02 21:23:51.459368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 85/163] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:23:52.217225 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:52.219623 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:52.234457 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:52.236560 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:52.237737 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:52.239636 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:52.240685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:52.241942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:52.801841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:52.818541 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f01edde9-b9a3-487e-8921-8596b9e3f1ae tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.609169 Sep 02 21:23:52.819814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 79/164] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:52 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:53.702390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-8866bb4b-061a-4db8-b27f-06ac4740a5da req-d6857297-f16c-4c81-867d-1882952a1523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c79e24-443d-42bb-baa0-e9da52325154", "tag": "6f431917-787d-4d70-8710-69f6656d5ead"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:23:53.713310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8866bb4b-061a-4db8-b27f-06ac4740a5da req-d6857297-f16c-4c81-867d-1882952a1523 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:53.713938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8866bb4b-061a-4db8-b27f-06ac4740a5da req-d6857297-f16c-4c81-867d-1882952a1523 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:53.714600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8866bb4b-061a-4db8-b27f-06ac4740a5da req-d6857297-f16c-4c81-867d-1882952a1523 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:53.727925 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-8866bb4b-061a-4db8-b27f-06ac4740a5da req-d6857297-f16c-4c81-867d-1882952a1523 service nova] Creating event network-changed:6f431917-787d-4d70-8710-69f6656d5ead for instance c0c79e24-443d-42bb-baa0-e9da52325154 on hv-cinder-85220 Sep 02 21:23:53.735751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-8866bb4b-061a-4db8-b27f-06ac4740a5da req-d6857297-f16c-4c81-867d-1882952a1523 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035868 Sep 02 21:23:53.735751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 86/165] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:23:53.879073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:53.879073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:53.879073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:53.879073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:53.881053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:53.881053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:53.881053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:53.881053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:54.098720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:54.109312 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-16b20932-ea3a-444e-9eb5-6a390949b379 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.254945 Sep 02 21:23:54.110046 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 80/166] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:53 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:55.139805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:55.140511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:55.147158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:55.147576 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:55.148014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:55.148717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:55.149180 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:55.149607 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:55.315666 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:55.345949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d2b4426b-fd03-4d74-86c3-61157207d8ca tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.210760 Sep 02 21:23:55.346547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 87/167] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:55 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:56.388182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:56.388794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:56.396009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:56.396840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:56.396998 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:56.397631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:56.398113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:56.398530 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:56.580131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:56.589496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7cc2aaa3-0cd9-4943-917e-261629294d26 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.207229 Sep 02 21:23:56.590433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 81/168] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:56 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:57.616183 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:57.617048 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:57.623228 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:57.623714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:57.624152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:57.624855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:57.625305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:57.626068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:57.798003 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:57.814018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f2506953-15fd-41d7-b9c8-7d0863011738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.201637 Sep 02 21:23:57.815126 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 88/169] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:57 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:23:58.839467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:23:58.840684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:23:58.850353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:58.850868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:58.851385 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:58.856872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:23:58.859855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:23:58.860345 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:23:59.079288 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:23:59.090320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4e03c1f1-096a-48be-b42c-8f4400c1198d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.255405 Sep 02 21:23:59.091284 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 82/170] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:23:58 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:00.097757 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:00.098885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:00.107850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:00.108478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:00.109136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:00.110353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:00.110666 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:00.111334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:00.125344 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:00.137563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:00.137563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=79 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:00.137563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:00.137563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:00.137972 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:00.137972 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:00.138426 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:00.138879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:00.151630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:24:00.297538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:00.305785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-866506c4-b272-4afb-a0aa-ad636afb701c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.184397 Sep 02 21:24:00.306464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 83/171] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:00 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:00.711493 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-953dc279-ea95-4b67-8c38-34edddee1475 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "DELETE /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 204 len: 0 microversion: 2.1 time: 0.626976 Sep 02 21:24:00.714568 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 89/172] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:24:00 2022] DELETE /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:24:00.732228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:00.733170 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:00.739690 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:00.740252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:00.740697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:00.741524 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:00.741922 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:00.742360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:00.905432 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:00.910860 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-24df8fd0-2f39-4079-9d41-3886f478010b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1555 microversion: 2.1 time: 0.185178 Sep 02 21:24:00.911452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 84/173] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:00 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:01.332893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:01.333628 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:01.341741 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:01.343241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:01.343241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:01.344291 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:01.345093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:01.345871 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:01.515370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:01.523511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-89dacc7e-3ba9-4b6e-b3bf-73715ebd33bb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.196210 Sep 02 21:24:01.524083 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 90/174] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:01 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:01.939036 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:01.939644 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:01.947160 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:01.947683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:01.948124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:01.948828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:01.949282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:01.949710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:02.092909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:02.102908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f1641a10-a7a5-47da-b13a-160779ff3b36 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1555 microversion: 2.1 time: 0.167723 Sep 02 21:24:02.103496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 85/175] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:01 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:02.554428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:02.555141 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:02.568335 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:02.569165 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:02.570029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:02.570955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:02.571427 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:02.571876 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:02.802471 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:02.816641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5fc756e8-d9e2-48dc-9e2f-336eec36e029 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.269357 Sep 02 21:24:02.818098 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 91/176] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:02 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:03.130506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:03.131463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:03.139462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:03.139886 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:03.140440 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:03.141305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:03.142164 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:03.142634 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:03.340358 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:03.350398 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-49101613-c7ce-4167-9592-b1ec339ea870 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1555 microversion: 2.1 time: 0.226850 Sep 02 21:24:03.350975 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 86/177] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:03 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1555 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:03.853065 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:03.857139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:03.893723 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:03.894901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:03.895932 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:03.897631 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:03.899753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:03.904815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:04.380514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:04.381616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:04.394024 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:04.394809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:04.395573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:04.396807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:04.397616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:04.398400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:04.440680 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:04.454711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-030a8db3-09cf-4278-8a8d-501a0a8b8a03 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.611392 Sep 02 21:24:04.462054 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 92/178] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:03 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:04.580617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:04.590574 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1d0ca0ee-7ac4-4fca-ad20-bd687458cac7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1555 microversion: 2.1 time: 0.216513 Sep 02 21:24:04.591697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 87/179] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:04 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:04.960807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-1acbabaa-7a6a-4f51-aa46-53576143a109 req-55685bd5-7be3-465d-a5c9-82ce16d00331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cd645d-2c7b-4d0e-889b-2a84f911b5d2", "name": "network-vif-deleted", "tag": "22e52286-ac23-4daa-89c9-c5ad908c745a"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:04.989499 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1acbabaa-7a6a-4f51-aa46-53576143a109 req-55685bd5-7be3-465d-a5c9-82ce16d00331 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:04.990693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1acbabaa-7a6a-4f51-aa46-53576143a109 req-55685bd5-7be3-465d-a5c9-82ce16d00331 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:04.992033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1acbabaa-7a6a-4f51-aa46-53576143a109 req-55685bd5-7be3-465d-a5c9-82ce16d00331 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:05.034530 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-1acbabaa-7a6a-4f51-aa46-53576143a109 req-55685bd5-7be3-465d-a5c9-82ce16d00331 service nova] Creating event network-vif-deleted:22e52286-ac23-4daa-89c9-c5ad908c745a for instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 on hv-cinder-85220 Sep 02 21:24:05.043845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-1acbabaa-7a6a-4f51-aa46-53576143a109 req-55685bd5-7be3-465d-a5c9-82ce16d00331 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090158 Sep 02 21:24:05.044628 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 93/180] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:05.233075 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1623121277", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "networks": [{"uuid": "e47a31a6-75bb-4964-889d-3ce9e7152802"}]}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:05.334588 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.network.neutron [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] validate_networks() for [('e47a31a6-75bb-4964-889d-3ce9e7152802', None, None, None, None, None)] {{(pid=121512) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:24:05.483057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:05.484802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:05.491303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:05.491793 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:05.492238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:05.492946 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:05.493501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:05.493958 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:05.836893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:05.854629 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0a024eb2-e660-4e17-a243-d0a633116b01 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.375592 Sep 02 21:24:05.855828 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 94/181] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:05 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:05.863494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:05.864366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:05.876621 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:05.879551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:05.879551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:05.879551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:05.879551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:05.880426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:06.047309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:06.058861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-01273264-127b-417f-9691-389039301344 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1346 microversion: 2.1 time: 0.200807 Sep 02 21:24:06.059454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 95/182] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:05 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1346 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:06.094909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Flavor limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:24:06.095746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Image limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:24:06.095746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Flavor pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:24:06.096076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Image pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:24:06.096492 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:24:06.107619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:06.108205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:06.108715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:06.109463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:06.109979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:06.110393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:06.135400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Getting quotas for project 5f6a7d90bafa459f8a24d89a10132b78. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:24:06.141715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Getting quotas for user 7431e8c106ba4e2689c0aa1001bbafe7 and project 5f6a7d90bafa459f8a24d89a10132b78. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:24:06.157928 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Going to run 1 instances... {{(pid=121512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:24:06.161213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:24:06.381310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-70d23e1d-a83c-4255-b345-e713bc02cdf7 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.154536 Sep 02 21:24:06.385923 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 88/183] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:24:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1159 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:24:06.407335 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e020a71f-fe7c-464b-8ed5-837d48bf7c3b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:06.411794 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e020a71f-fe7c-464b-8ed5-837d48bf7c3b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:06.539659 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e020a71f-fe7c-464b-8ed5-837d48bf7c3b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:06.561595 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e020a71f-fe7c-464b-8ed5-837d48bf7c3b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1219 microversion: 2.1 time: 0.166425 Sep 02 21:24:06.562722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 96/184] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:06 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:06.903360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:06.903968 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:06.913328 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:06.913870 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:06.914318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:06.915162 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:06.915619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:06.916207 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:07.088622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:07.090480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:07.114856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:07.114856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:07.120323 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:07.121146 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:07.124801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:07.124801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:07.125103 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:07.135849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-833c7d53-239c-46d3-9441-a273d9a51f8c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.237240 Sep 02 21:24:07.136526 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 89/185] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:06 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:07.257094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:07.267933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-55883a3d-7925-46c2-8291-89cb8c5ae966 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1346 microversion: 2.1 time: 0.184492 Sep 02 21:24:07.268855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 97/186] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:07 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1346 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:07.605122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f551d87d-8c59-408c-af52-53df39b991d5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:07.605754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f551d87d-8c59-408c-af52-53df39b991d5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:07.695717 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f551d87d-8c59-408c-af52-53df39b991d5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:07.706293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f551d87d-8c59-408c-af52-53df39b991d5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1219 microversion: 2.1 time: 0.106240 Sep 02 21:24:07.707840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 90/187] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:07 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:08.177620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:08.178759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:08.189952 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:08.190796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:08.191490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:08.196458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:08.196995 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:08.198317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:08.296613 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:08.299423 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:08.315575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:08.316085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:08.316528 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:08.317587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:08.318297 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:08.318879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:08.375183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:08.376278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:08.376278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:08.377327 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lazy-loading 'fault' on Instance uuid 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:08.456278 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:08.459399 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:08.465801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a9be0953-7814-4ec2-9464-82ac9db9ab10 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.295941 Sep 02 21:24:08.466807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 98/188] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:08 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:08.474958 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7b407a51-a550-447f-8120-53ee811b7c83 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1351 microversion: 2.1 time: 0.182842 Sep 02 21:24:08.476151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 91/189] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:08 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1351 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:08.740398 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:08.741355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:08.750047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:08.750548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:08.751116 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:08.751851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:08.752503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:08.752909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:08.824989 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:08.839465 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-905e9199-a17d-4c49-889b-7a3b1feefa41 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1223 microversion: 2.1 time: 0.102780 Sep 02 21:24:08.840435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 99/190] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:08 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:09.506452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:09.507164 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:09.508852 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:09.510763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:09.515662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:09.516809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:09.517726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:09.517953 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:09.518903 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:09.519351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:09.519523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:09.520062 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:09.520433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:09.520629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:09.521264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:09.521424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:09.580770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:09.580955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:09.581328 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:09.581762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lazy-loading 'fault' on Instance uuid 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:09.652090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:09.664992 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1b444f3d-59f2-4167-b7a9-3718ad24d1e0 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1351 microversion: 2.1 time: 0.163453 Sep 02 21:24:09.668214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 92/191] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:09 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:09.775477 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:09.783687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-07e31984-1003-4297-b0cd-9b13d3f69929 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.281996 Sep 02 21:24:09.784256 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 100/192] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:09 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:09.864976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:09.865587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:09.872642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:09.873130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:09.873556 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:09.874286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:09.874734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:09.875152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:09.952648 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:09.961730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3728293c-0e24-40b7-ab7e-911b63d4b670 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1215 microversion: 2.1 time: 0.100827 Sep 02 21:24:09.974039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 93/193] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:09 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:10.692870 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:10.693551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:10.701711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:10.702367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:10.702860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:10.703586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:10.704029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:10.704449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:10.751774 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:10.752293 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:10.752823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:10.753295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lazy-loading 'fault' on Instance uuid 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:10.815532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:10.817700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:10.821407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:10.830524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a5a1e685-0375-405b-91d0-fbf9654c46e8 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1351 microversion: 2.1 time: 0.140687 Sep 02 21:24:10.830745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:10.831021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:10.831659 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:10.832552 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:10.832668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 101/194] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:10 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:10.833644 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:10.834274 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:10.838457 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:10.986495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:10.987312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:10.998019 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:10.998846 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:10.999609 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:11.001494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:11.002832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:11.003302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:11.057244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:11.068619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bf0d43a7-7462-44ec-8fe8-47f700232ce0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.263051 Sep 02 21:24:11.069432 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 94/195] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:10 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:11.078434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:11.082956 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:11.093238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-458b5a49-ff94-4718-a45b-8433130c81ec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1215 microversion: 2.1 time: 0.110970 Sep 02 21:24:11.093731 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 102/196] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:10 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:11.866544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:11.867440 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:11.876069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:11.876562 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:11.883016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:11.883016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:11.883016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:11.883016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:11.921681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:11.922206 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:11.922641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:11.923103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lazy-loading 'fault' on Instance uuid 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:11.969912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:11.984984 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f9c824fc-1052-42e8-804b-adf8476cdad4 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1351 microversion: 2.1 time: 0.122563 Sep 02 21:24:11.986047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 95/197] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:11 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:12.110693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:12.112312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:12.120583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:12.121086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:12.121524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:12.122282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:12.122733 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:12.123163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:12.124351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:12.125346 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:12.139089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:12.139598 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:12.140230 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:12.141178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:12.141762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:12.142388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:12.289740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:12.312828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1ab2a2aa-b8a2-43b4-b4db-25e621c18421 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1215 microversion: 2.1 time: 0.186286 Sep 02 21:24:12.312828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 96/198] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:12 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1215 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:12.417310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:12.426851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b8be8642-b939-407a-bfd2-ed79d4c45c6f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.320857 Sep 02 21:24:12.427692 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 103/199] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:12 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:13.011811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:13.012444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:13.019319 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:13.019812 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:13.020251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:13.020969 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:13.021431 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:13.021894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:13.062058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:13.062058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:13.062669 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:13.063452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lazy-loading 'fault' on Instance uuid 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:13.129178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:13.142044 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6dd60702-fb83-4f49-ac86-9e44f8b60fcb tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1351 microversion: 2.1 time: 0.133448 Sep 02 21:24:13.142631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 97/200] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:13 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1351 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:13.344097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:13.344865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:13.351845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:13.354309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:13.354309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:13.354309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:13.354883 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:13.355532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:13.425631 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:13.436014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-90acf348-bdd5-46fb-9ee6-bcaad74797e1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1271 microversion: 2.1 time: 0.096102 Sep 02 21:24:13.436696 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 104/201] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:13 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:13.465255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:13.466805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:13.477210 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:13.477849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:13.479253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:13.480342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:13.481184 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:13.481997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:13.672934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:13.684791 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7e099a01-6aea-437a-8895-903257ed0d2b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.226911 Sep 02 21:24:13.685981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 98/202] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:13 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:14.174343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:14.175242 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:14.186340 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:14.186872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:14.187319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:14.188053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:14.188496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:14.189107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:14.237078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:14.237670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:14.238156 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:14.238610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lazy-loading 'fault' on Instance uuid 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:14.317624 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:14.330843 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-edb82235-56ed-4b78-8d2a-2c7043eb95a7 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1351 microversion: 2.1 time: 0.162540 Sep 02 21:24:14.332104 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 105/203] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:14 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:14.462046 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:14.463315 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:14.470755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:14.471260 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:14.471898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:14.472794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:14.473426 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:14.474059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:14.546110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:14.556905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f62a38c2-3803-45fa-b839-524e2c85ef25 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1271 microversion: 2.1 time: 0.098273 Sep 02 21:24:14.558566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 99/204] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:14 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:14.720117 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:14.720833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:14.727545 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:14.728788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:14.729673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:14.730495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:14.731024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:14.731461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:14.893650 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:14.902554 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4fcb5fee-d4e7-4231-b271-44064512ae8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.187068 Sep 02 21:24:14.903150 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 106/205] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:14 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:15.360879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:15.361487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:15.367909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:15.368412 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:15.369140 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:15.369539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:15.370317 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:15.371125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:15.446651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:15.447490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:15.448215 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:15.448981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lazy-loading 'fault' on Instance uuid 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:15.504333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02bf6738503a44b0908ecd38116842d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90aa668555c54d508063d931dba2d751', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:15.514311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6d221884-8ac7-4436-86fa-cbdcfd3bdbd1 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 200 len: 1351 microversion: 2.1 time: 0.157390 Sep 02 21:24:15.515016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 100/206] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:15 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 1351 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:15.588340 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:15.589654 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:15.599273 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:15.602777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:15.602777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:15.602777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:15.604174 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:15.604965 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:15.708285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:15.719896 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-88b5dc72-0bf0-4820-905d-33a1918925a5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1271 microversion: 2.1 time: 0.139410 Sep 02 21:24:15.720949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 107/207] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:15 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1271 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:15.928846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:15.929459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:15.937418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:15.938043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:15.938494 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:15.939208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:15.939693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:15.940111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:16.115441 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:16.117830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:16.124876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-46492e4f-adea-417c-b235-4ae0719d2257 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.200699 Sep 02 21:24:16.125441 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 101/208] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:15 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:16.554400 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:16.562318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:16.573161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:16.575255 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:16.577072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:16.577598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:16.579998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:16.583699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:16.584280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:16.618275 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] HTTP exception thrown: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Request method failure captured: Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 HTTP/1.1 Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQpGqNS3hH5kBgk6S9YhNykXsBc3i9QjK5PTiR8rMC0Hzk-6UCgOVmGpmyT0anXwMpVj-YPjwK0GuEP1nHCQ8LDr8UCM3742vW2VGBKysXMWS92Vq-wEFXtaIkcA9NMHKeiqEC-qk3VWBECRqQ-SBpYSnkaY-zVHbH8PN110cEXEpo Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 90aa668555c54d508063d931dba2d751 Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:24:16.623902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/90aa668555c54d508063d931dba2d751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_90aa668555c54d508063d931dba2d751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90aa668555c54d508063d931dba2d751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90aa668555c54d508063d931dba2d751"}]}] Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 90aa668555c54d508063d931dba2d751 Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-DeleteServersTestJSON-345101764-project Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: 02bf6738503a44b0908ecd38116842d2 Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-DeleteServersTestJSON-345101764-project Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.625409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '34cd645d-2c7b-4d0e-889b-2a84f911b5d2'} Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:16.626259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.627803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.630179 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Returning 404 to user: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:16.632194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0a10f26a-5fd6-4479-b4f9-6c3ed1e1da01 tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 404 len: 111 microversion: 2.1 time: 0.088065 Sep 02 21:24:16.633477 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 108/209] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:16 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:16.751633 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:16.767337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:16.774280 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:16.777617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:16.778662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:16.779582 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:16.783241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:16.783858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:16.866208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:16.877047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3306c20f-edc8-475d-a1dc-48225968de54 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1279 microversion: 2.1 time: 0.131553 Sep 02 21:24:16.879052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 102/210] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:16 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1279 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:16.926472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:16.929456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:16.936027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:16.936697 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:16.937181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:16.938248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:16.938841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:16.939261 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:16.954673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] HTTP exception thrown: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Request method failure captured: Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2/os-volume_attachments HTTP/1.1 Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQpGqNS3hH5kBgk6S9YhNykXsBc3i9QjK5PTiR8rMC0Hzk-6UCgOVmGpmyT0anXwMpVj-YPjwK0GuEP1nHCQ8LDr8UCM3742vW2VGBKysXMWS92Vq-wEFXtaIkcA9NMHKeiqEC-qk3VWBECRqQ-SBpYSnkaY-zVHbH8PN110cEXEpo Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 90aa668555c54d508063d931dba2d751 Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:24:16.956209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/90aa668555c54d508063d931dba2d751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_90aa668555c54d508063d931dba2d751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90aa668555c54d508063d931dba2d751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90aa668555c54d508063d931dba2d751"}]}] Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 90aa668555c54d508063d931dba2d751 Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-DeleteServersTestJSON-345101764-project Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: 02bf6738503a44b0908ecd38116842d2 Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-DeleteServersTestJSON-345101764-project Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.957638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'server_id': '34cd645d-2c7b-4d0e-889b-2a84f911b5d2'} Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:16.958857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:16.959983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:16.961137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Returning 404 to user: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:16.961137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3bb651c1-6810-45f6-9ee8-a430b8be4f7f tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035743 Sep 02 21:24:16.961137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 109/211] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:24:16 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:17.151443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:17.151965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:17.160241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:17.160988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:17.164372 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:17.164372 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:17.164372 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:17.164372 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:17.418655 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:17.429174 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-499f2b05-00ec-4e9a-a002-4549f15e4f38 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.283136 Sep 02 21:24:17.429174 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 103/212] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:17 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:17.909637 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:17.910432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:17.920832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:17.921233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:17.921903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:17.922960 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:17.923627 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:17.924113 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:18.084398 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:18.095042 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a7b919ab-84a0-407f-aac0-ca2f75f263ce tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.190177 Sep 02 21:24:18.096962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 110/213] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:17 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:18.452111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:18.452752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:18.455109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=8 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:18.460707 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:18.473496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:18.473496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:18.473496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:18.473496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:18.474453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:18.627474 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:18.640943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4b8e6a0a-ea81-404f-b970-780289c69dba tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.192368 Sep 02 21:24:18.641547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 104/214] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:18 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:19.120497 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:19.121224 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:19.123841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:19.128647 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:19.129197 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:19.129647 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:19.130471 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:19.131260 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:19.132007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:19.321712 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:19.334961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c64f2def-939c-4d79-89ad-fcc276850edf tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.218923 Sep 02 21:24:19.335882 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 111/215] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:19 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:19.670107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:19.671008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:19.678366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:19.678861 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:19.679302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:19.680018 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:19.680467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:19.681496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:19.877743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:19.887778 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-11c982af-30c4-42ef-82a8-46aaff03cded tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.222630 Sep 02 21:24:19.888470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 105/216] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:19 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:20.361312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:20.362274 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:20.372570 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:20.373034 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:20.373683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:20.377456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:20.377963 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:20.378397 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:20.646756 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:20.663147 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d53204e6-40a3-455b-9d88-12a8d11183fd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.306715 Sep 02 21:24:20.672401 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 112/217] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:20 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:20.872784 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-50a8ae4b-c980-4a41-9845-18fd2c7372ba req-411dd22a-f22f-46c7-8f62-80af349eb955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ba005ca-8059-46ef-bcaa-3b543cdfa6f3", "tag": "c93c7163-1b06-42a9-bf19-914550a78cf5"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:20.874587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-50a8ae4b-c980-4a41-9845-18fd2c7372ba req-411dd22a-f22f-46c7-8f62-80af349eb955 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:20.875716 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-50a8ae4b-c980-4a41-9845-18fd2c7372ba req-411dd22a-f22f-46c7-8f62-80af349eb955 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:20.876474 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-50a8ae4b-c980-4a41-9845-18fd2c7372ba req-411dd22a-f22f-46c7-8f62-80af349eb955 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:20.905730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-50a8ae4b-c980-4a41-9845-18fd2c7372ba req-411dd22a-f22f-46c7-8f62-80af349eb955 service nova] Creating event network-changed:c93c7163-1b06-42a9-bf19-914550a78cf5 for instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 on hv-cinder-85220 Sep 02 21:24:20.914527 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-50a8ae4b-c980-4a41-9845-18fd2c7372ba req-411dd22a-f22f-46c7-8f62-80af349eb955 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072121 Sep 02 21:24:20.926208 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:20.928828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 106/218] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:20.929024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:20.940001 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:20.940771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:20.941387 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:20.942349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:20.943284 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:20.943751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:21.162467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:21.173844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-bccc515d-5d43-4aac-bd82-dbf63d3de279 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.253954 Sep 02 21:24:21.174062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 113/219] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:20 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:21.690370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:21.692484 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:21.709681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:21.710607 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:21.712525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:21.714059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:21.714684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:21.715336 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:22.005580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:22.016685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-85cbeefc-ef41-4132-9dcd-3ffe3ca68d07 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.331301 Sep 02 21:24:22.018111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 107/220] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:21 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:22.211076 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:22.211872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:22.221999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:22.222582 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:22.223156 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:22.223893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:22.224378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:22.225135 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:22.749445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:22.765791 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-06c072b5-05d8-44da-9666-7c046ecd58b5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.558591 Sep 02 21:24:22.767236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 114/221] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:22 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:23.048743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:23.049703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:23.057419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:23.057877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:23.058309 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:23.059021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:23.059661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:23.060087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:23.080853 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:23.081357 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:23.088857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:23.089926 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:23.090810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:23.091883 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:23.092608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:23.093115 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:23.117685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] HTTP exception thrown: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Request method failure captured: Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: DELETE /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 HTTP/1.1 Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQpGqNS3hH5kBgk6S9YhNykXsBc3i9QjK5PTiR8rMC0Hzk-6UCgOVmGpmyT0anXwMpVj-YPjwK0GuEP1nHCQ8LDr8UCM3742vW2VGBKysXMWS92Vq-wEFXtaIkcA9NMHKeiqEC-qk3VWBECRqQ-SBpYSnkaY-zVHbH8PN110cEXEpo Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 90aa668555c54d508063d931dba2d751 Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:24:23.120622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/90aa668555c54d508063d931dba2d751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_90aa668555c54d508063d931dba2d751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90aa668555c54d508063d931dba2d751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90aa668555c54d508063d931dba2d751"}]}] Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 90aa668555c54d508063d931dba2d751 Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-DeleteServersTestJSON-345101764-project Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: 02bf6738503a44b0908ecd38116842d2 Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-DeleteServersTestJSON-345101764-project Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.123241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '34cd645d-2c7b-4d0e-889b-2a84f911b5d2'} Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:23.125037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.128561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.130105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Returning 404 to user: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:23.130105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b1cc9d03-2062-48eb-ae8b-90057569417b tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "DELETE /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 404 len: 111 microversion: 2.1 time: 0.045611 Sep 02 21:24:23.130105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 115/222] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:24:23 2022] DELETE /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:24:23.137209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:23.137923 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] [instance: 34cd645d-2c7b-4d0e-889b-2a84f911b5d2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:23.144729 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:23.145222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:23.145748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:23.147202 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:23.148086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:23.149798 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:23.176708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] HTTP exception thrown: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Request method failure captured: Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 HTTP/1.1 Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQpGqNS3hH5kBgk6S9YhNykXsBc3i9QjK5PTiR8rMC0Hzk-6UCgOVmGpmyT0anXwMpVj-YPjwK0GuEP1nHCQ8LDr8UCM3742vW2VGBKysXMWS92Vq-wEFXtaIkcA9NMHKeiqEC-qk3VWBECRqQ-SBpYSnkaY-zVHbH8PN110cEXEpo Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 90aa668555c54d508063d931dba2d751 Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:24:23.179651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/90aa668555c54d508063d931dba2d751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_90aa668555c54d508063d931dba2d751"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90aa668555c54d508063d931dba2d751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/90aa668555c54d508063d931dba2d751"}]}] Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 90aa668555c54d508063d931dba2d751 Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-DeleteServersTestJSON-345101764 Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-DeleteServersTestJSON-345101764-project Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: 02bf6738503a44b0908ecd38116842d2 Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-DeleteServersTestJSON-345101764-project Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.182028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '34cd645d-2c7b-4d0e-889b-2a84f911b5d2'} Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:23.182880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. Sep 02 21:24:23.184327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:23.185295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] Returning 404 to user: Instance 34cd645d-2c7b-4d0e-889b-2a84f911b5d2 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:23.185295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b7d0f1c9-b50a-4fbc-8307-31f6c4a5164c tempest-DeleteServersTestJSON-345101764 tempest-DeleteServersTestJSON-345101764-project] 10.222.0.79 "GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2" status: 404 len: 111 microversion: 2.1 time: 0.049819 Sep 02 21:24:23.185295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 116/223] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:23 2022] GET /compute/v2.1/servers/34cd645d-2c7b-4d0e-889b-2a84f911b5d2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:24:23.253493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:23.264550 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e87cb515-f73e-4b4f-9962-e4aaa5082505 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.220453 Sep 02 21:24:23.265957 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 108/224] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:23 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:23.818461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:23.819880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:23.832417 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:23.832417 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:23.833421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:23.834815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:23.835806 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:23.837228 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:24.086160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:24.102182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-262f40c0-13e5-4b8b-9f9a-282de0de593b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.291034 Sep 02 21:24:24.103456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 117/225] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:23 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:24.290327 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:24.291268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:24.300039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:24.305986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:24.305986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:24.305986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:24.305986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:24.306501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:24.511247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:24.522639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-59146854-57e1-4d47-94d8-6f3d50fe85a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.236775 Sep 02 21:24:24.538827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 109/226] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:24 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:25.145464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:25.146577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:25.156486 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:25.157485 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:25.158183 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:25.159053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:25.159763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:25.160524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:25.490301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:25.511920 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3cc0b0b1-587a-42dc-a5b3-44cfffb2e6fb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.370475 Sep 02 21:24:25.512927 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 118/227] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:25 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:25.563862 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:25.565020 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:25.579217 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:25.580398 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:25.583041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:25.584430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:25.585531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:25.586758 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:25.614043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:25.847952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:25.867428 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-38b75a3a-5c82-4a5b-a36c-dc13385059a0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.311231 Sep 02 21:24:25.871497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 110/228] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:25 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:26.560449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:26.561113 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:26.573203 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:26.574121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:26.576043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:26.577030 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:26.578474 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:26.579047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:26.829753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:26.851699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-af63116d-38e4-44c0-af9c-52acfb63306b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.296576 Sep 02 21:24:26.858014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 119/229] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:26 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:26.918187 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:26.919436 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:26.935977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:26.937356 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:26.938793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:26.940462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:26.941525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:26.942596 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:27.411884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:27.425377 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-06dc321a-ac67-4307-9a33-d14880f74c13 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.523552 Sep 02 21:24:27.426529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 111/230] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:26 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:27.471511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-d79781ea-c2bc-46cc-ac21-d9ec247ea876 req-425f1641-609a-4ab2-a35f-4094eb41c169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba005ca-8059-46ef-bcaa-3b543cdfa6f3", "name": "network-vif-plugged", "status": "completed", "tag": "c93c7163-1b06-42a9-bf19-914550a78cf5"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:27.492201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d79781ea-c2bc-46cc-ac21-d9ec247ea876 req-425f1641-609a-4ab2-a35f-4094eb41c169 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:27.494250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d79781ea-c2bc-46cc-ac21-d9ec247ea876 req-425f1641-609a-4ab2-a35f-4094eb41c169 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:27.495482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d79781ea-c2bc-46cc-ac21-d9ec247ea876 req-425f1641-609a-4ab2-a35f-4094eb41c169 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:27.520446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-d79781ea-c2bc-46cc-ac21-d9ec247ea876 req-425f1641-609a-4ab2-a35f-4094eb41c169 service nova] Creating event network-vif-plugged:c93c7163-1b06-42a9-bf19-914550a78cf5 for instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 on hv-cinder-85220 Sep 02 21:24:27.533740 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-d79781ea-c2bc-46cc-ac21-d9ec247ea876 req-425f1641-609a-4ab2-a35f-4094eb41c169 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068937 Sep 02 21:24:27.534755 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 120/231] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:27.903303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:27.904011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:27.911196 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:27.919647 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:27.919647 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:27.919647 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:27.919647 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:27.921520 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:28.424779 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:28.446232 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9ecd9796-e0cd-429a-a7aa-083315dd8755 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.547561 Sep 02 21:24:28.451268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 112/232] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:27 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:28.472610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:28.482674 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:28.491029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:28.492004 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:28.493111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:28.494383 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:28.495299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:28.496682 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:28.881283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:28.906194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f9af8bed-7b72-4241-888d-3cb3cbbfd92f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.438842 Sep 02 21:24:28.906194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 121/233] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:28 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:29.485535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:29.486459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:29.494982 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:29.551711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:29.551711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:29.551711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:29.551711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:29.552258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:29.703436 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:29.724564 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-84e66bc7-3175-463f-a4e4-d4e6713b7a67 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.241962 Sep 02 21:24:29.730083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 113/234] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:29 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:29.958538 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:29.958538 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:29.958538 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:29.960553 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:29.962473 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:29.964438 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:29.965457 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:29.966452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:30.002778 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:30.294309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:30.302793 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-aea06f18-ea36-4605-a92c-f4e4ce2bf285 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.363236 Sep 02 21:24:30.303921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 122/235] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:29 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:30.756597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:30.759392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:30.770549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:30.770871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:30.771795 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:30.772725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:30.773798 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:30.774641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:31.031351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:31.045428 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-aeb9e894-a8ce-44a3-b848-e31696df7d8a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1522 microversion: 2.1 time: 0.293225 Sep 02 21:24:31.047705 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 114/236] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:30 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:31.367775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:31.368782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:31.378310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:31.378815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:31.379293 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:31.380288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:31.380917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:31.381613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:31.582970 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:31.600030 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4001a45a-71ae-4cb4-a9dc-33ec926e1f8f tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.236103 Sep 02 21:24:31.612565 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 123/237] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:31 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:32.088187 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:32.089341 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:32.093834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:32.103249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:32.104118 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:32.104882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:32.106228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:32.107023 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:32.107804 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:32.457599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:32.477451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a3f36625-2094-4e2d-b66c-706180a653c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1502 microversion: 2.1 time: 0.397162 Sep 02 21:24:32.479205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 115/238] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:32 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:32.508233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:32.509143 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:32.516458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:32.524583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:32.524583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:32.524583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:32.524583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:32.525182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:32.635765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:32.636806 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:32.647502 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:32.648681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:32.649828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:32.654278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:32.663614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:32.664553 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:32.727234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:32.745376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-eadd3cc5-3485-4d1a-8423-aee15a171185 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1516 microversion: 2.1 time: 0.241893 Sep 02 21:24:32.748479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 124/239] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:32 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:33.095518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:33.115280 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-54fdcadf-e9ad-4ccf-9954-34d8efc49927 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1319 microversion: 2.1 time: 0.488436 Sep 02 21:24:33.116336 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 116/240] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:32 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:34.144194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:34.145538 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:34.154689 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:34.155288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:34.155835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:34.156707 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:34.157314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:34.158044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:34.410590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:34.427329 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-49ace4c6-0905-4ad1-8f91-45698d092594 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1508 microversion: 2.1 time: 0.290303 Sep 02 21:24:34.431703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 125/241] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:34 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:35.863105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c3481e41-593b-4872-ae4f-f32f34f0ceb4 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Action: 'create', calling method: .version_select at 0x7fb00d861040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2089424954", "metadata": {"Type": "work"}}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:37.451747 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:37.457832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:37.470511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:37.471295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:37.471878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:37.473094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:37.474842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:37.478371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:37.516732 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lazy-loading 'flavor' on Instance uuid 3610c813-9d2a-44e4-a9a5-5652a58fd962 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:37.599898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c3481e41-593b-4872-ae4f-f32f34f0ceb4 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.291217 Sep 02 21:24:37.601509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 117/242] 10.222.0.79 () {60 vars in 1156 bytes} [Fri Sep 2 21:24:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2294 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 21:24:37.618221 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a291dc39-d35a-4890-b8c4-d40e884a13e0 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Calling method '.version_select at 0x7fb00ce94280>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:37.923016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a291dc39-d35a-4890-b8c4-d40e884a13e0 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc" status: 200 len: 353 microversion: 2.1 time: 0.310631 Sep 02 21:24:37.923607 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 118/243] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:37 2022] GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc => generated 353 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:24:38.211956 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b9a2cd0d-35fd-4387-b47d-2238d80798c7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962/action" status: 200 len: 32 microversion: 2.1 time: 0.768139 Sep 02 21:24:38.216309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 126/244] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:24:37 2022] POST /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962/action => generated 32 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:24:38.229284 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:38.229284 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:38.239039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:38.239825 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:38.240553 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:38.242364 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:38.244069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:38.244797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:38.435371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:38.446734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9c10f8df-f51b-4d28-96b7-2544a5a986ff tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.226527 Sep 02 21:24:38.447722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 119/245] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:38 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:38.949127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d0477f42-3108-4252-b008-9bda07f1a411 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Calling method '.version_select at 0x7fb00ce30ee0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:39.103823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d0477f42-3108-4252-b008-9bda07f1a411 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc" status: 200 len: 353 microversion: 2.1 time: 0.160130 Sep 02 21:24:39.105164 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 127/246] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:38 2022] GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc => generated 353 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:39.473514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:39.474196 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:39.482019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:39.482570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:39.483213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:39.484452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:39.484908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:39.485419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:39.683068 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:39.692588 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-95f9d618-15f7-48d3-8bcf-2eba4396e73a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.223546 Sep 02 21:24:39.707667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 120/247] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:39 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:40.135392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-87a5b970-a663-43d1-8f24-38433e9335c4 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Calling method '.version_select at 0x7fb00ce301f0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:40.229909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-87a5b970-a663-43d1-8f24-38433e9335c4 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc" status: 200 len: 354 microversion: 2.1 time: 0.102801 Sep 02 21:24:40.231255 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 128/248] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:40 2022] GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:40.256222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-733c2800-5bc9-4082-b96a-7de4eb35a587 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Calling method '.version_select at 0x7fb00d861af0>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:40.369525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-733c2800-5bc9-4082-b96a-7de4eb35a587 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc" status: 200 len: 354 microversion: 2.1 time: 0.121617 Sep 02 21:24:40.378741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 121/249] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:40 2022] GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:40.398035 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-722713f7-652d-417b-9bc2-ce0ec32eb44f tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Calling method '.version_select at 0x7fb00ce309d0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:40.742048 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:40.743855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:40.757600 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:40.758600 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:40.759907 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:40.760425 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:40.760994 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:40.761491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:40.798754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-722713f7-652d-417b-9bc2-ce0ec32eb44f tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc" status: 202 len: 0 microversion: 2.1 time: 0.407642 Sep 02 21:24:40.805509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 129/250] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:24:40 2022] DELETE /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:24:40.812887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d8177e02-f7b9-4970-bbc4-1b3aaa596bbd tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Calling method '.version_select at 0x7fb00ce3c9d0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:40.982338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d8177e02-f7b9-4970-bbc4-1b3aaa596bbd tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc" status: 200 len: 353 microversion: 2.1 time: 0.175096 Sep 02 21:24:40.982978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 130/251] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:40 2022] GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc => generated 353 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:41.318843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:41.331057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8aede1b3-a849-4388-b17e-238b8023d766 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.597728 Sep 02 21:24:41.337509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 122/252] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:40 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:42.005192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dbd387e9-09a8-4e5a-ab96-8290efa124a3 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Calling method '.version_select at 0x7fb00ce304c0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-dbd387e9-09a8-4e5a-ab96-8290efa124a3 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] HTTP exception thrown: Volume 642670aa-3ee4-4557-8a34-83d4016b6fbc could not be found. Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dbd387e9-09a8-4e5a-ab96-8290efa124a3 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Request method failure captured: Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc HTTP/1.1 Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnSTEH_h93OtCjhgwP-Y3gUUqk0CL-6iwYRFOxA6hxJrEUz-b8p7fzI4ZU_j5Tj9Ngk5r7R_fVfj3KXB7aL3GIya-oPiISmInteRRTWAuAY-4CO4qK1TjpMc30km3NKq4KDsTBlSQE3AWALCB2g5Pp6qGejqlhEcvMCWl4XB-zfhJCc Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 87c7b1832bef4bd6bda46ceb7bacd8ae Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-VolumesGetTestJSON-1317163966 Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:24:42.086442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/87c7b1832bef4bd6bda46ceb7bacd8ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_87c7b1832bef4bd6bda46ceb7bacd8ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/87c7b1832bef4bd6bda46ceb7bacd8ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/87c7b1832bef4bd6bda46ceb7bacd8ae"}]}] Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-VolumesGetTestJSON-1317163966 Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 87c7b1832bef4bd6bda46ceb7bacd8ae Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-VolumesGetTestJSON-1317163966 Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-VolumesGetTestJSON-1317163966-project Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: df2d0289a0b24fbfa4fc4a9ddf2f78f5 Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-VolumesGetTestJSON-1317163966-project Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Volume 642670aa-3ee4-4557-8a34-83d4016b6fbc could not be found. Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '642670aa-3ee4-4557-8a34-83d4016b6fbc'} Sep 02 21:24:42.088395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 642670aa-3ee4-4557-8a34-83d4016b6fbc could not be found. (HTTP 404) (Request-ID: req-3e54f633-5747-42f8-a614-51b678f2de30) Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:42.089961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 02 21:24:42.091317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 642670aa-3ee4-4557-8a34-83d4016b6fbc could not be found. Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 02 21:24:42.092523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 642670aa-3ee4-4557-8a34-83d4016b6fbc could not be found. Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 642670aa-3ee4-4557-8a34-83d4016b6fbc could not be found. Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dbd387e9-09a8-4e5a-ab96-8290efa124a3 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] Returning 404 to user: Volume 642670aa-3ee4-4557-8a34-83d4016b6fbc could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:24:42.093709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dbd387e9-09a8-4e5a-ab96-8290efa124a3 tempest-VolumesGetTestJSON-1317163966 tempest-VolumesGetTestJSON-1317163966-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc" status: 404 len: 109 microversion: 2.1 time: 0.082184 Sep 02 21:24:42.106133 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 131/253] 10.222.0.79 () {58 vars in 1245 bytes} [Fri Sep 2 21:24:41 2022] GET /compute/v2.1/os-volumes/642670aa-3ee4-4557-8a34-83d4016b6fbc => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:24:42.369859 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:42.373286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:42.392053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:42.392053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:42.394646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:42.398740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:42.403368 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:42.405368 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:42.690115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:42.717180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-06dffdc7-b422-4a00-b34b-2893650989a9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.359747 Sep 02 21:24:42.718736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 123/254] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:42 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:43.760398 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:43.762960 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:43.774823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:43.775556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:43.776156 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:43.777033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:43.777766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:43.778376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:44.105998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:44.125969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-348acd47-258c-409b-bff4-a6ae9b9cc237 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.375807 Sep 02 21:24:44.127728 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 132/255] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:43 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:45.179800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:45.183260 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:45.203111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:45.204099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:45.204962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:45.206311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:45.207047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:45.208130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:45.559679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:45.573614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5a328b25-12ee-4999-9bae-c9a5d43a5ef4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.410477 Sep 02 21:24:45.574669 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 124/256] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:45 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:46.614283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:46.615236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:46.643557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:46.647846 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:46.648619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:46.657455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:46.658599 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:46.660520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:47.039071 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:47.057976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ff3f429c-d44a-4038-80d4-14b8c2d297b6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.450402 Sep 02 21:24:47.058804 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 133/257] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:46 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:47.857400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:47.858531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:47.879372 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:47.880195 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:47.880921 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:47.883180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:47.883770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:47.884305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:47.930413 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-247fb449-3622-4b1a-a14b-dd65742a93fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/ips" status: 200 len: 152 microversion: 2.20 time: 0.085251 Sep 02 21:24:47.931284 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 125/258] 10.222.0.79 () {60 vars in 1289 bytes} [Fri Sep 2 21:24:47 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/ips => generated 152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:24:48.098657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:48.099490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:48.121436 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:48.125048 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:48.127837 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:48.129731 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:48.135410 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:48.137273 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:48.595952 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:48.609018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-44ee3791-0b48-4365-a9d0-1ccf251e9254 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.515659 Sep 02 21:24:48.624455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 134/259] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:48 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:49.644152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:49.646555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:49.658184 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:49.659115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:49.659903 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:49.661157 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:49.662058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:49.663398 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:49.914622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:49.929487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-133a76be-e539-4e59-a10e-8c1f5615c03e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.292233 Sep 02 21:24:49.930302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 126/260] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:49 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:50.960686 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:50.961487 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:50.963833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=38 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:50.971163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:50.971978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:50.972473 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:50.979251 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:50.980158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:50.982868 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:51.255052 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:51.268864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4d030f64-566b-42b6-8380-5b6f80bb9a3a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.310900 Sep 02 21:24:51.290576 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 135/261] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:50 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:52.310246 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:52.314424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:52.339161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:52.343299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:52.344141 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:52.354448 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:52.354448 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:52.354448 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:53.004841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:53.020856 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5f6ed2a9-9f8e-47ee-8771-fddf4b02ffc0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.719552 Sep 02 21:24:53.025502 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 127/262] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:52 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:54.077474 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:54.078949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:54.091714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.092722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.093441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.094348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.095625 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.096280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.592492 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:24:54.593877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:54.618591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.618591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.618591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.618591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:54.620339 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:54.620900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:54.723032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lazy-loading 'flavor' on Instance uuid 4f5852d6-c6ee-489d-a2cd-a1ce7008540f {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:24:55.051814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:55.071172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0b6f05b6-e127-4145-85fb-bc38790a1ad0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 1.000830 Sep 02 21:24:55.072708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 136/263] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:54 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:55.460638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:24:56.105647 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:56.117536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:56.117536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.117536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.117536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.127319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.127906 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.128365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.433062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.456044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ae69fd09-6a2e-4c98-a81f-0053cc4e5600 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.356578 Sep 02 21:24:56.467331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 137/264] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:56 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:24:56.509032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-18dd8af2-4ac6-4119-a50c-7b7ab4556ec3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/action" status: 202 len: 0 microversion: 2.20 time: 1.930194 Sep 02 21:24:56.513479 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 128/265] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Sep 2 21:24:54 2022] POST /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/action => generated 0 bytes in 1935 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:24:56.520685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:56.522293 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:56.547653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.548496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.549191 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.550300 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:56.551149 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:56.551826 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:56.862985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.876200 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.879650 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:56.889956 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5210ec3b-cff4-4bc6-906f-4ae108aef6ae tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.365421 Sep 02 21:24:56.889956 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 138/266] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:56 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:24:57.511615 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:57.513200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:57.527181 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.528606 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.529358 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:57.531103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.531968 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.532813 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:57.768532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:57.782061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-57e826af-e926-48e3-97d9-880e98887448 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.278815 Sep 02 21:24:57.791312 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 129/267] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:57 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:57.919600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:57.920946 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:57.931840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.932991 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.933957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:57.935179 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:57.936083 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:57.936803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:58.151038 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:58.169663 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:58.172718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:58.175049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a62570ce-befd-4994-95c6-bba3a19aea6f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.260087 Sep 02 21:24:58.176072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 139/268] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:57 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:24:58.818938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:58.829866 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:58.829866 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:58.829866 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:58.829866 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:58.830643 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:58.831379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:58.831820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.068198 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.085489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-76ded30c-b043-44f7-8633-7fa88dbe36a3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.269949 Sep 02 21:24:59.086753 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 130/269] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:24:58 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:24:59.217868 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:59.218633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:59.227957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:59.228751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:59.229598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.231200 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:59.232123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:59.232974 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.303481 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:24:59.312090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:24:59.359473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:59.360464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:59.362043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.366779 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:24:59.368222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:24:59.369483 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:24:59.443678 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-38661df0-77d8-4032-a608-c3a91f8afba7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/ips" status: 200 len: 145 microversion: 2.1 time: 0.147531 Sep 02 21:24:59.445843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 131/270] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:24:59 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/ips => generated 145 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:24:59.580616 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.592315 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.596992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:24:59.596992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b66455ba-0c11-48e6-b2ce-86e9775c4dcb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.384970 Sep 02 21:24:59.602436 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 140/271] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:24:59 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:00.083973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d21a005d-6247-474d-ac9a-d8812a8d2e38 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Action: 'create', calling method: .version_select at 0x7fb00ce94820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-261479926", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNm7HD1R0LLg5z8V47Z9eRuMQYWwt4Xmdl1lVl8nzVAou3XuYcl4sEwstPsKWl1R5Oft8hwlYqumtZdPCvi5Oo6stxm4qavlk+e0TlCXj6YrHFD+0DPMFfvIHx+0eZ9PGQ=="}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:00.114538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-d21a005d-6247-474d-ac9a-d8812a8d2e38 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Getting quotas for project d0d9b4769b124ec69714a30d02bb8557. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:25:00.122777 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-d21a005d-6247-474d-ac9a-d8812a8d2e38 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Getting quotas for user e2940758d8424054bf3a68a42b79bb81 and project d0d9b4769b124ec69714a30d02bb8557. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:25:00.129469 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:00.129469 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:00.135805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:00.136305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:00.136780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:00.137943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:00.138233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:00.138770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:00.321391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d21a005d-6247-474d-ac9a-d8812a8d2e38 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.478073 Sep 02 21:25:00.321391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 132/272] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:24:59 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:00.368012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:00.384996 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-54ea122f-2779-4eda-86e1-0e3ce8505ab3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.264613 Sep 02 21:25:00.393764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 141/273] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:00 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:00.636583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:00.636583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:00.645727 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:00.649785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:00.650589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:00.651688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:00.652337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:00.653356 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:00.913143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:00.922759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:00.924244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:00.926311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-503f4f72-d64e-4a51-b9a1-035a719b4864 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.300876 Sep 02 21:25:00.927418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 133/274] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:00 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:01.433608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:01.434958 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:01.446192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:01.447394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:01.448346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:01.449791 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:01.450768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:01.451910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:01.459953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:01.665122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:01.678652 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7b45333f-7d48-4d1a-90be-211a54a99fbe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.248601 Sep 02 21:25:01.690628 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 142/275] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:01 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:01.955775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:01.956557 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:01.964902 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:01.965400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:01.965920 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:01.966960 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:01.967587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:01.968016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:02.183710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:02.197762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:02.200571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:02.202630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a812e6dc-ff6c-487f-b7d4-435a8b51755b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.250741 Sep 02 21:25:02.203637 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 134/276] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:01 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:02.704693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:02.706698 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:02.722766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:02.724988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:02.741056 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:02.742770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:02.743648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:02.744107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:03.095606 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:03.128554 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0f4ff066-4265-4be0-967a-85762036ad69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.412887 Sep 02 21:25:03.130130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 143/277] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:02 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:03.237888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:03.239796 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:03.252161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:03.253682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:03.268408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:03.268408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:03.268408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:03.268408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:03.518800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:03.532586 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:03.535018 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:03.536912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-974cd02e-2fa8-4643-bc2f-4990c890ad78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.305573 Sep 02 21:25:03.537786 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 135/278] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:03 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:04.171222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:04.172345 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:04.185497 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:04.186331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:04.187035 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.188443 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:04.189079 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:04.190029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.550629 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:04.575738 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d796480e-8f40-4f9a-9047-9040b3debead tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.414896 Sep 02 21:25:04.576884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:04.578396 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:04.586170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 144/279] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:04 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:04.604649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:04.608330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:04.613877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.615489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:04.616343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:04.617027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:04.983808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:04.997918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:05.000081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:05.011623 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9b98cb54-359a-4367-948f-dd6f9140b0f2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.432390 Sep 02 21:25:05.011623 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 136/280] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:04 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:05.619146 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:05.620362 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:05.628105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.628892 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.629531 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.631068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:05.631803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:05.632404 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:05.851001 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:05.863630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2dfd71d7-d2a3-4e5c-9d3d-65d1d9cce45e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.248399 Sep 02 21:25:05.865411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 145/281] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:05 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:06.035173 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:06.035874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:06.044551 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:06.045024 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:06.045487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:06.046321 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:06.046692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:06.047115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:06.230172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:06.243996 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:06.246699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:06.248731 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-69d74d00-0372-42c2-9837-5d992ac96481 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.218370 Sep 02 21:25:06.249662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 137/282] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:06 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:06.899027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:06.899803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:06.906876 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:06.907363 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:06.907810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:06.908523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:06.908988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:06.909414 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.080472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.093193 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5eae66be-0072-4432-8e39-7b7211df992b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.198436 Sep 02 21:25:07.093801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 146/283] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:06 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:07.286930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:07.288630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:07.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:07.301502 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.303374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.303374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.304095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.304551 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.304990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.348059 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "038938cf-f9cb-4de8-bdf8-f0807c04a1de"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:07.354877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:07.368586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.370234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.371772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.373771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:07.375852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:07.377480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:07.597492 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.612263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.616243 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:07.618532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9ef1cadf-0ca4-47e5-8708-b0586b056b4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.338363 Sep 02 21:25:07.619983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 138/284] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:07 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:08.123394 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:08.123995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:08.134162 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.134670 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.135107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.135819 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.136378 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.136828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.523964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.553270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-91fa3b90-f49a-4a55-b23d-b27ab5e9c571 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.433195 Sep 02 21:25:08.555641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 139/285] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:08 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:08.651768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:08.652760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:08.662119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.662995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.663946 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.666768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:08.667526 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:08.684855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:08.953363 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.971015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.972482 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:08.974284 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d85210e3-30cc-47d3-bcfa-6fe3a0b69a78 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.329063 Sep 02 21:25:08.975203 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 140/286] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:08 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:09.618388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:09.618388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:09.622449 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.623879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.624914 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.626803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:09.628143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:09.629119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:09.814209 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:09.823445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-25f6fa59-2f26-48c0-ba28-9cbedb04a4d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.217625 Sep 02 21:25:09.824125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 141/287] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:09 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:09.967280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ec03ebbf-8b2e-4c79-b1b8-c2210c4f006f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.625604 Sep 02 21:25:09.984714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 147/288] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:25:07 2022] POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/os-volume_attachments => generated 194 bytes in 2627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:10.011815 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:10.012766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:10.023045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:10.023862 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:10.024612 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:10.025770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:10.026627 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:10.027449 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:10.136130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=4 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:10.245446 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.256592 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.258124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:10.259438 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b3c7778c-84e2-490c-8836-252a9afd9996 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.252635 Sep 02 21:25:10.260003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 142/289] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:10 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:10.853116 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:10.854230 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:10.867574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:10.868374 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:10.869019 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:10.874468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:10.874468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:10.874468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.078229 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:11.090260 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a994e606-f6c1-4747-ae98-a1e1ed107134 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.243201 Sep 02 21:25:11.091896 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 148/290] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:10 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:11.293434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:11.294061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:11.301035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.306050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.306050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.306050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:11.306050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:11.306688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:11.481226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:11.495459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:11.496826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:11.498042 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-21f2cca3-e65d-463b-96e9-9ea114c41862 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.210075 Sep 02 21:25:11.498601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 143/291] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:11 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:12.139452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:12.139452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:12.142450 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.143511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.144609 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.146647 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.147921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.148909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.376671 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:12.390181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-30aa5160-77ec-4d58-a4a0-9aaa006a2f25 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.275749 Sep 02 21:25:12.391192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 149/292] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:12 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:12.535003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:12.536114 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:12.546839 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.547357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.547792 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.548736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:12.549663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:12.550140 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:12.805836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:12.822951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:12.825560 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:12.827656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ce02e3a9-32db-43a4-ba77-07d392375cb4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.298578 Sep 02 21:25:12.828337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 144/293] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:12 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:13.429416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:13.430178 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:13.441843 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:13.444877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:13.444877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:13.445836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:13.446716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:13.447288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:13.630548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:13.641293 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ad533ec1-9a57-409c-b76d-d985946062d8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.217575 Sep 02 21:25:13.642212 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 150/294] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:13 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:13.868518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:13.870008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:13.888028 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:13.894331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:13.894331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:13.894331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:13.894331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:13.897402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.181577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:14.192722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:14.194589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:14.195840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1a3f6276-a3eb-4eb4-a8d9-0615b80676af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.332446 Sep 02 21:25:14.199391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 145/295] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:13 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:14.677266 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:14.678773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:14.687459 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.688541 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.689644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.690909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:14.691596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:14.693204 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:14.943364 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:14.959918 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5b2bfd10-46e3-413f-a43d-89a1f997cc0d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.291398 Sep 02 21:25:14.962448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 151/296] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:14 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:15.224799 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:15.225410 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:15.233406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:15.233943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:15.234391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:15.235137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:15.235599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:15.247729 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:15.253158 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:15.406508 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.420476 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.423269 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:15.424967 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-74518e1d-83a9-42d6-80a4-b27206a87e5c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.204979 Sep 02 21:25:15.425641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 146/297] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:15 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:15.626956 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c00a948b-6d8e-414c-903a-76953f0406e2", "device": "/dev/sdb"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:15.632332 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:15.640154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:15.640945 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:15.641575 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:15.642599 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:15.643240 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:15.643833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.008290 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:16.009004 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:16.017586 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.018141 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.018624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.019396 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.020114 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.021499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.181547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:16.190064 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b37a09a4-9a28-4080-bd29-04b96849c77e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.188443 Sep 02 21:25:16.190654 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 147/298] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:15 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:16.467075 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:16.472286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:16.494338 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.501155 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.508836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.510133 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:16.510948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:16.511839 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:16.779538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:16.794305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:16.805337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:16.805337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-703cb0b1-1609-4abf-929b-60826a36c8e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.346297 Sep 02 21:25:16.805337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 148/299] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:16 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:17.245026 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:17.246032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:17.255728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.256523 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.257400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.258264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.259120 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.259666 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.463701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:17.472474 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4762e83f-b6ae-44ac-9a65-63a5f1a469ac tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.237452 Sep 02 21:25:17.473435 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 149/300] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:17 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:17.850482 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:17.853135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:17.864448 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.865985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.866743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:17.867799 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:17.868437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:17.869016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.049093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:18.064574 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:18.066611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:18.068209 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c4ca19e2-69e3-4887-963e-c33d23e8ccdd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.228905 Sep 02 21:25:18.070075 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 150/301] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:17 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:18.172652 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9a7961d0-853a-403a-9a6a-ea21fe275eae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "POST /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.550500 Sep 02 21:25:18.173678 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 152/302] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:25:15 2022] POST /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3/os-volume_attachments => generated 194 bytes in 2553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:18.499002 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:18.499684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:18.507425 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.507911 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.508335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.509345 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.510577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.511204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.696734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:18.714422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ef728f74-6824-463d-a430-aa999f5e1f63 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1502 microversion: 2.1 time: 0.221856 Sep 02 21:25:18.727909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 151/303] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:18 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:18.745306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e45dc1c1-2007-49a9-b257-1c6f8fd85e30"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:18.748301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:18.759122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.759959 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.760599 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.761516 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.762179 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.762810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.941901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] HTTP exception thrown: Cannot 'attach_volume' instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 while it is in vm_state rescued Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Request method failure captured: Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: POST /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962/os-volume_attachments HTTP/1.1 Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 74 Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQuA7tr86m4arxlUyz1sKUAwEHai_4Lbj-lbjLGsK0D8VwzMO5HYHfVyme-dtN2n9o9oDWjrb8bC4VcXT_A5AIzkitlo1KlXTYvF5IhqjNxpa-cx0MrRsLQ7OafI1s5xNuMBjK0TqgGEyiJR7OUFvdDhk0a1rWWQCmaEcIS6F4kp-I Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:25:18.944161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}] Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: c81bafbe3e444e84a7da18ac9d782479 Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {"volumeAttachment": {"volumeId": "e45dc1c1-2007-49a9-b257-1c6f8fd85e30"}} Sep 02 21:25:18.947867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Cannot 'attach_volume' instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 while it is in vm_state rescued Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'server_id': '3610c813-9d2a-44e4-a9a5-5652a58fd962', 'body': {'volumeAttachment': {'volumeId': 'e45dc1c1-2007-49a9-b257-1c6f8fd85e30'}}} Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:25:18.948668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 while it is in vm_state rescued Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:25:18.950024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:25:18.951152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:25:18.951152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:25:18.951152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 while it is in vm_state rescued Sep 02 21:25:18.951152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:25:18.951152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Returning 409 to user: Cannot 'attach_volume' instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 while it is in vm_state rescued {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:25:18.951152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b1cd922b-3798-4ee6-817c-165be387a4fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.211210 Sep 02 21:25:18.953039 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 153/304] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:25:18 2022] POST /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962/os-volume_attachments => generated 152 bytes in 214 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 21:25:18.962818 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:18.963738 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:18.970595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.971507 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.972012 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:18.972821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:18.973472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:18.974699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.095668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:19.097079 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:19.103872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.104352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.104786 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.105479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.105970 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.106389 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.251018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.263898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.265279 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.266746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-eaae4ab2-e8eb-462c-9e08-3464a128d2e9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.175839 Sep 02 21:25:19.267579 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 154/305] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:19 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:19.354394 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-011fce7b-9d67-48e6-8a0b-da299b7c66cd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962/action" status: 202 len: 0 microversion: 2.1 time: 0.395687 Sep 02 21:25:19.355021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 152/306] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:25:18 2022] POST /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:25:19.369029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:19.369736 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:19.377286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.377853 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.378369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.379118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:19.379583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:19.380021 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:19.569106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:19.576638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-27ee669d-6c88-4007-bd72-00544383ff15 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1510 microversion: 2.1 time: 0.213796 Sep 02 21:25:19.577998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 155/307] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:19 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:20.302506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:20.302506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:20.313163 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.313676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.314147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.314868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.315386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.315813 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.584564 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.594295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.596656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.598469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ba1765bf-cf66-4853-9ac0-ef323c71e3f1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.303617 Sep 02 21:25:20.600389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 153/308] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:20 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:20.606325 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:20.607686 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:20.615418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.616065 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.616572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.617787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:20.618745 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:20.619367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:20.641096 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:20.811838 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:20.822045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d8597401-9549-483e-a636-8c9842a6b24c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1510 microversion: 2.1 time: 0.219906 Sep 02 21:25:20.823137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 156/309] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:20 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:21.631093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:21.631705 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:21.639279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.639739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.640184 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.640925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.641393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.641831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.784284 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:21.792332 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:21.793792 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:21.795038 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d20e6e47-50e7-409a-9b71-e9d32fe098b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.168525 Sep 02 21:25:21.795596 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 154/310] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:21 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:21.859393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:21.860750 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:21.874864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.875434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.876063 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:21.876842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:21.877369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:21.878267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.042488 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:22.051375 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-24889e9e-bfbc-40f1-a036-10576c546436 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1510 microversion: 2.1 time: 0.198481 Sep 02 21:25:22.052353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 157/311] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:21 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1510 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:22.822831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:22.823704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:22.830630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:22.831454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:22.832123 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:22.833003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:22.833629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:22.834286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:23.078259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:23.079929 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:23.086530 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:23.087022 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:23.087490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:23.088162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:23.088642 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:23.089070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:23.169407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:23.179406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:23.180903 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:23.182319 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-edbd5dba-5fd5-4ece-91da-9cdf6f6abbea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1744 microversion: 2.20 time: 0.364806 Sep 02 21:25:23.182875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 155/312] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:22 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1744 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:23.349555 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:23.361940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0f67cf22-92eb-4ec7-a1e9-98f2885e18fc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1510 microversion: 2.1 time: 0.289502 Sep 02 21:25:23.376115 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 158/313] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:23 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1510 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:24.222975 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:24.223690 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:24.238283 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:24.239211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:24.240393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.241351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:24.242522 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:24.243083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.392216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:24.393479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:24.407297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=48 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:24.416009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:24.416009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:24.416009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.416009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:24.416399 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:24.426421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:24.687754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.700828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.709017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.713517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0f95cabb-f103-4e26-b8d5-cba40945b9bc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1744 microversion: 2.20 time: 0.495207 Sep 02 21:25:24.726046 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 156/314] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:24 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1744 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:24.833023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:24.847616 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fadafdc0-8ded-4718-86f7-ce6bda75f7ce tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1510 microversion: 2.1 time: 0.460800 Sep 02 21:25:24.849489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 159/315] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:24 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1510 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:25.337662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-88f05f39-8a40-409c-8e3d-81f70c4c77d1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:25.352902 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88f05f39-8a40-409c-8e3d-81f70c4c77d1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.353710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88f05f39-8a40-409c-8e3d-81f70c4c77d1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.354593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88f05f39-8a40-409c-8e3d-81f70c4c77d1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.461911 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-88f05f39-8a40-409c-8e3d-81f70c4c77d1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Going to try to stop instance {{(pid=121512) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 21:25:25.703803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-88f05f39-8a40-409c-8e3d-81f70c4c77d1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/action" status: 202 len: 0 microversion: 2.1 time: 0.371283 Sep 02 21:25:25.710619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 157/316] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:25:25 2022] POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/action => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:25:25.719726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:25.720809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:25.731472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.732256 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.732852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.733836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.735050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.735811 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.746146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:25.747376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:25.758073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.758596 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.759036 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:25.759777 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:25.760241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:25.761513 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.006630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:26.009617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:26.017352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-06dc4d3b-3cc0-47ec-bbca-50e192e38ead tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.304646 Sep 02 21:25:26.020520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 160/317] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:25 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:26.042172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:26.043706 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:26.044888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9d94cf46-9bce-483a-813c-3804678182e8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1744 microversion: 2.20 time: 0.303675 Sep 02 21:25:26.045533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 158/318] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:25 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1744 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:26.051145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:26.052581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:26.060121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.060888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.061560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.062637 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:26.063510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:26.064124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:26.300160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:26.313077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-16630396-b2bf-4883-80d6-26d72b9cbb4b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1510 microversion: 2.1 time: 0.290918 Sep 02 21:25:26.326494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 161/319] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:26 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1510 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:27.058687 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:27.060617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:27.078211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:27.079602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:27.089535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.090753 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.092167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.093765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.094351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.095470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.099638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.099638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.099638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.099638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.100093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.100093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.471074 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:27.492415 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:27.494580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:27.502040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:27.504669 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-248558f7-4fab-4b6c-8365-9085012b7a34 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1744 microversion: 2.20 time: 0.424435 Sep 02 21:25:27.517744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 162/320] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:27 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1744 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:27.517744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:27.517744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:27.521324 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.524602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.525370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.528759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-37d54ef6-b188-4819-b8d7-58e6010d3030 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.474083 Sep 02 21:25:27.529661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:27.530173 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:27.534987 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:27.535204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 159/321] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:27 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:27.677187 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:27.686106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6f769e18-e5a3-4834-838f-217d72e10ec9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1510 microversion: 2.1 time: 0.179117 Sep 02 21:25:27.690011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 163/322] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:27 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1510 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:28.533189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:28.534009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:28.542247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:28.542744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:28.543354 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:28.544395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:28.544893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:28.545430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:28.565734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:28.567269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:28.581701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:28.582595 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:28.583410 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:28.584807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:28.586408 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:28.587124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.139367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.150566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.152422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9ee80286-078a-47ca-984f-45c607b06437 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.595618 Sep 02 21:25:29.157027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 164/323] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:28 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:29.161573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.163621 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.164887 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d810f7c3-688e-438c-88d4-56ff9bc33cbc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1744 microversion: 2.20 time: 0.635579 Sep 02 21:25:29.165857 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 160/324] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:28 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1744 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:29.177824 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:29.179123 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:29.190997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-540986c7-623c-4040-bd01-94cec50fff76 req-d19e3144-0f10-452a-88ec-ca4ab345f0be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5852d6-c6ee-489d-a2cd-a1ce7008540f", "name": "network-vif-plugged", "status": "completed", "tag": "9c460ac1-1f81-408f-907d-b19a443be414"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:29.196876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.196876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.196876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.196876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.197286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.197286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.199247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:29.219965 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-540986c7-623c-4040-bd01-94cec50fff76 req-d19e3144-0f10-452a-88ec-ca4ab345f0be service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:29.221789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-540986c7-623c-4040-bd01-94cec50fff76 req-d19e3144-0f10-452a-88ec-ca4ab345f0be service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:29.222450 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-540986c7-623c-4040-bd01-94cec50fff76 req-d19e3144-0f10-452a-88ec-ca4ab345f0be service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:29.238241 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-540986c7-623c-4040-bd01-94cec50fff76 req-d19e3144-0f10-452a-88ec-ca4ab345f0be service nova] Creating event network-vif-plugged:9c460ac1-1f81-408f-907d-b19a443be414 for instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f on hv-cinder-85220 Sep 02 21:25:29.244244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-540986c7-623c-4040-bd01-94cec50fff76 req-d19e3144-0f10-452a-88ec-ca4ab345f0be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085306 Sep 02 21:25:29.248559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 165/325] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:29.468568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:29.480721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c47ae43b-e56b-4c2d-8206-08cfe167ca44 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1516 microversion: 2.1 time: 0.313582 Sep 02 21:25:29.500267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 161/326] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:29 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1516 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:30.184787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:30.186100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:30.201107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.205646 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.207902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.209420 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.210376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.211077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.213464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:30.214120 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:30.235286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.236402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.237351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.238840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:30.242913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:30.243704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:30.852342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:30.861484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f77318c7-917e-45b3-b988-9da3f67b7a6b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.683715 Sep 02 21:25:30.862276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 166/327] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:30 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:31.035395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:31.050868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:31.052962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:31.055058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-48f18b7b-7e6a-4e43-9079-6de4bca2392f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.852489 Sep 02 21:25:31.072002 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 162/328] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:30 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:31.901096 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:31.905055 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:31.928475 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:31.929618 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:31.930910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:31.932197 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:31.933085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:31.933909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.085671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:32.088226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:32.115914 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:32.116906 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:32.118059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.119638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:32.120547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:32.121268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:32.679527 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:32.688941 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:32.690468 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:32.691807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7fa0ee28-2b46-4e52-ac16-90fb1d4db262 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.611064 Sep 02 21:25:32.728803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 163/329] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:32 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:32.743323 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:32.769157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f924bc41-bc03-444d-b551-528ec1c93832 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.873610 Sep 02 21:25:32.775120 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 167/330] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:31 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:32.944492 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-53999f94-f591-4140-95e6-4b7894c521c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'create', calling method: .version_select at 0x7fb00ce949d0>, body: {"keypair": {"name": "tempest-keypair-1730082136", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN59G0zsu4I2jyE9i1uJZIc/6WrUZcOQN06a5XoF/pC1ST0AvKI0VORdNAF6pD/lMb3PezdE5iTrZdID0FLjgq7Tc/V8GPQ78d1mh8Rbzn8XJ4cHP7vW4FbSzGhtvtBhEg=="}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:32.965267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-53999f94-f591-4140-95e6-4b7894c521c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Getting quotas for project 347df6259a3e48fcbdcbb3f895d38bd4. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:25:32.980964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-53999f94-f591-4140-95e6-4b7894c521c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Getting quotas for user c81bafbe3e444e84a7da18ac9d782479 and project 347df6259a3e48fcbdcbb3f895d38bd4. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:25:33.134528 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-53999f94-f591-4140-95e6-4b7894c521c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194380 Sep 02 21:25:33.138893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 164/331] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:25:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:33.747468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:33.748276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:33.761977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:33.764298 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:33.765038 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:33.769418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:33.772474 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:33.779068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:33.805072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:33.806104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:33.840031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:33.840031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:33.840031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:33.840031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:33.840538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:33.840538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:34.199095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.223941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.228624 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.229916 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dcd9430e-53ec-4ec3-a200-ce95ed92c31f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.487367 Sep 02 21:25:34.234000 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 168/332] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:33 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:34.276839 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:34.293664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-43ade047-63b3-4fef-88eb-8f9b72c6665e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.492856 Sep 02 21:25:34.297278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 165/333] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:33 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:35.264105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:35.265416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:35.288236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.288816 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.289363 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.296793 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.303633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.304368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.321455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:35.322136 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:35.340652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.340652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.340652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.340652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:35.341058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:35.357227 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:35.829703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:35.842919 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:35.866706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:35.869249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d425d88f-90df-4ac1-8cc7-93535e84c043 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.552520 Sep 02 21:25:35.874482 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 166/334] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:35 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:35.879810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:35.884157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-013e96fb-5e27-48ca-afe8-ed789e8e5e49 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.624622 Sep 02 21:25:35.885574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 169/335] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:35 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:36.901167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:36.902147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:36.955784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:36.959189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:36.995091 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:36.999460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.000769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.000769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.001427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.004877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.006638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.008964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.057304 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.058669 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:37.059362 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:37.059967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:37.563239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.598151 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.600026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.614598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0227001f-bf52-4eac-8ada-e6aa431ccd2c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.668373 Sep 02 21:25:37.626661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 170/336] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:36 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:37.702808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:37.720509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f59b2eb0-a9fa-4bac-979a-44315ce153d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.825308 Sep 02 21:25:37.724370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 167/337] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:36 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:38.653454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:38.654215 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:38.680475 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.682642 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.684193 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.688842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.701336 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.702050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.770400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:38.772878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:38.813096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.818892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.819783 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:38.826058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:38.826913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:38.830929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:39.525130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:39.534561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:39.544158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:39.545408 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ea1db3ac-9c94-48b1-addf-2874499f6f8a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.896676 Sep 02 21:25:39.562873 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 171/338] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:38 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:39.597925 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1592689076", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3b84c7e7-9382-422d-bbad-24b7eb0f0aad"}], "security_groups": [{"name": "tempest-securitygroup--1148930647"}], "key_name": "tempest-keypair-1730082136", "user_data": "}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:39.734566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:39.748248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-28eea348-4f73-4f6d-8bd9-c9e2c23bb604 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.995505 Sep 02 21:25:39.761903 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 168/339] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:38 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:40.602898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:40.603623 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:40.661514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:40.681147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:40.696159 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:40.705199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:40.705701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:40.734660 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:41.396825 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:41.422250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:41.424304 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:41.427567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bd249b1a-d863-480e-859f-338d6a73733c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.836947 Sep 02 21:25:41.432492 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 169/340] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:40 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:41.452766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:41.453741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:41.455960 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:41.469020 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:41.469531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:41.471904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:41.476497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:41.476497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:41.480543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:41.766622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:41.783086 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-79463667-8a5f-413f-9ec6-5e3e15e787db tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.338607 Sep 02 21:25:41.798675 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 170/341] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:41 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:42.468069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:42.468671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:42.476942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:42.477558 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:42.478097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.478894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:42.479419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:42.480386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.647326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.659242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.662237 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.666392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-cf8015d1-bf02-4f48-8397-2a1b8f9b56a5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.200161 Sep 02 21:25:42.667292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 171/342] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:42 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:42.814715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:42.815439 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:42.825250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:42.825746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:42.826290 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.827003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:42.827457 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:42.827928 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:42.997292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:42.999745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=4 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:43.009342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b08d153d-14f9-4eb0-bf84-acf6f145ef87 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.199079 Sep 02 21:25:43.010555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 172/343] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:42 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:43.701224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:43.701224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:43.711437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.711939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.712405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:43.713629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:43.714292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:43.714885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:44.038360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:44.054246 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:44.060276 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:44.065388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ed065789-c2fa-4301-b5ff-2bcbf9621d93 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.371676 Sep 02 21:25:44.071054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 173/344] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:43 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:44.086688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:44.087506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:44.106353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:44.106353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:44.106695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:44.107338 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:44.113898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:44.114451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:44.533393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:44.545029 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c6df4ea0-a0a6-4902-80e3-b8fd5ead33da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.471394 Sep 02 21:25:44.546039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 174/345] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:44 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:45.102679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:45.104144 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:45.129176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.132713 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.138288 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:45.148565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.149121 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.153991 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:45.486202 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:45.500935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:45.502549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:45.506347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-eaf2c8c7-544e-4084-a7fe-ad3d106aac14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.407961 Sep 02 21:25:45.509887 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 175/346] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:45 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:45.574278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:45.575260 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:45.589563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.591211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.593429 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:45.595689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:45.605461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:45.606995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:46.000513 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:46.010858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d22bc4cf-cf32-40f2-97bb-1135ef096349 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.444946 Sep 02 21:25:46.025182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 176/347] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:45 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:46.542237 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:46.544199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:46.559722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:46.560607 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:46.563518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:46.569941 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:46.572886 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:46.574851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:46.935365 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:46.951445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:46.954915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:46.956116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a3a443e1-5b39-44f2-8d61-c14e8d234fa9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.421089 Sep 02 21:25:46.976753 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 177/348] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:46 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:47.045848 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:47.046473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:47.068390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:47.068390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:47.068390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:47.068390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:47.068909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:47.068909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:47.482382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:47.484654 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:47.500808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ca5d7510-eee9-486b-906b-25afe1ac4f3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.458888 Sep 02 21:25:47.502279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 178/349] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:47 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:48.031238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:48.035331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:48.060276 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:48.061709 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:48.061709 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:48.062342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:48.062863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:48.063576 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:48.320372 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:48.358313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:48.361998 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:48.364752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a1260bf1-a058-44ff-9de8-f4c520b10734 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.357760 Sep 02 21:25:48.365788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 179/350] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:48 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:48.528342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:48.528954 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:48.536842 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:48.537337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:48.537777 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:48.538526 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:48.538987 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:48.539415 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.008827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.008827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-97c35bc5-2ef8-4804-930e-2d737ebbd1fd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.175926 Sep 02 21:25:50.008827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 180/351] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:48 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:50.008827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:50.014834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:50.014834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.014834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.014834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.017050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.017050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.017050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.017406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=89 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:50.019022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.019022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.019242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.019242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5178b5fa-f5ea-4a86-8be4-84414919da40 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.190488 Sep 02 21:25:50.019242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 181/352] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:49 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:50.019498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=27 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:50.019595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:50.019595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:50.019595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.019595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.019945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.019945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.019945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.019945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.020224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.020224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8c3f0d9f-cc78-47c8-9ffd-cf9ac896f232 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.193418 Sep 02 21:25:50.020224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 182/353] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:49 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:50.620488 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:50.621422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:50.648171 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.649531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.651486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.652294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.655597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.656138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.919363 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.941923 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.943754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:50.945780 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ddc0516f-04df-4fad-ab98-8275bec53b9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.334535 Sep 02 21:25:50.946945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 183/354] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:50 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:50.961587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:50.962249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:50.980823 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.984751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.988875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:50.989677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:50.990241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:50.990685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:51.215430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:51.225431 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-89ec3bde-b09b-429a-a648-65e99329e7c2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.277254 Sep 02 21:25:51.229463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 184/355] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:50 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:51.977504 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:51.978115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:52.006970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:52.006970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:52.006970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:52.006970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:52.007307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:52.007307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:52.242256 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:52.258601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:52.260100 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:52.261335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7d2cca21-b49b-46c5-ad12-56c44e1627ad tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.288787 Sep 02 21:25:52.261937 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 185/356] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:51 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:52.299717 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:52.300660 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:52.337432 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:52.338633 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:52.346466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:52.348570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:52.349919 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:52.351167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:52.554877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] validate_networks() for [('3b84c7e7-9382-422d-bbad-24b7eb0f0aad', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:25:52.561226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:52.576089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bb4f9957-3da6-484a-8c55-af3e6f8bf6ca tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.294944 Sep 02 21:25:52.577071 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 186/357] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:52 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:53.220106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:25:53.220829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:25:53.222107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:25:53.222993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:25:53.224148 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:25:53.235770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.236252 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.237616 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.238816 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.240236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.240796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.267766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Getting quotas for project 347df6259a3e48fcbdcbb3f895d38bd4. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:25:53.272434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Getting quotas for user c81bafbe3e444e84a7da18ac9d782479 and project 347df6259a3e48fcbdcbb3f895d38bd4. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:25:53.287067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:25:53.289774 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:25:53.303472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:53.303472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:53.306527 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.307321 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.307925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.309126 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.309757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.310399 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.502785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d7b5aef9-6279-4b6d-a28f-e4a891aa9f88 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 13.937525 Sep 02 21:25:53.503328 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 172/358] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:25:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 13940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:25:53.520953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-271524d8-bad7-498b-91fd-cc291f97cbee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:53.521758 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-271524d8-bad7-498b-91fd-cc291f97cbee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:53.552759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.573006 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.573006 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.573006 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f21160ad-739c-484f-be80-1803ba22e330 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.284338 Sep 02 21:25:53.573391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 187/359] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:53 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:53.606605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:53.607519 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:53.616257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.616781 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.617235 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.618116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:53.618585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:53.619480 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:53.630160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-271524d8-bad7-498b-91fd-cc291f97cbee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.645866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-271524d8-bad7-498b-91fd-cc291f97cbee tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1246 microversion: 2.1 time: 0.125458 Sep 02 21:25:53.645866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 173/360] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:53 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:53.818520 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:53.845586 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b882e675-76e7-4aab-90b6-bfd867c8d9b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.225071 Sep 02 21:25:53.845586 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 188/361] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:53 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:54.601056 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:54.601679 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:54.611083 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:54.616342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:54.616342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:54.616342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:54.616342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:54.616981 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:54.688531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-cbb64ddb-eca8-41a5-9c2b-8db2f5a7629e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:54.688531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-cbb64ddb-eca8-41a5-9c2b-8db2f5a7629e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:54.766327 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cbb64ddb-eca8-41a5-9c2b-8db2f5a7629e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:54.776249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-cbb64ddb-eca8-41a5-9c2b-8db2f5a7629e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1246 microversion: 2.1 time: 0.094670 Sep 02 21:25:54.778276 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 189/362] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:54 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:54.808021 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:54.819901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:54.822053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:54.823619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-81a88a61-3c6f-4acf-8717-ada76c51b963 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.227088 Sep 02 21:25:54.824683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 174/363] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:54 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:54.857016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:54.857850 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:54.873136 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:54.876273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:54.878518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:54.881619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:54.882681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:54.883617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:55.072215 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:55.095680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7f8e02f7-fe12-4387-958a-2d87628d845c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.243164 Sep 02 21:25:55.109849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 190/364] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:54 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:55.803991 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-aad2817f-eae6-4d99-b9aa-f44029ba185e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:55.804524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-aad2817f-eae6-4d99-b9aa-f44029ba185e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:55.863304 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-aad2817f-eae6-4d99-b9aa-f44029ba185e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:55.866470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:55.867748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:55.871601 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-aad2817f-eae6-4d99-b9aa-f44029ba185e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1246 microversion: 2.1 time: 0.072744 Sep 02 21:25:55.878490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 175/365] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:55 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1246 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:55.878633 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:55.878633 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:55.878633 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:55.878633 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:55.879243 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:55.879243 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.007231 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5c36bbdb-215e-4741-b2c4-6efd42daebf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Action: 'create', calling method: .version_select at 0x7fb00cd468b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1956423974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKuVV3q9v6MEN5I/pqNME1bAVAjFY0bTPP7Cp+DRNbP8YNkKOLOhPWj0v42dELZ42lI+AkRnKN2vAj6Fq+sdLGD0USXYbcGd+8QO5iBLn4gPX1t7vQ68VaibvScnDQ+kDg=="}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:56.028153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-5c36bbdb-215e-4741-b2c4-6efd42daebf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Getting quotas for project 2a715e1b8137477b9f39b1d6d8d0d268. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:25:56.033222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-5c36bbdb-215e-4741-b2c4-6efd42daebf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Getting quotas for user b0884441f5744f09b23823752684fe08 and project 2a715e1b8137477b9f39b1d6d8d0d268. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:25:56.035038 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.053711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.055556 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.056675 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-df81617e-399d-450f-a858-9b84758c4dd5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1739 microversion: 2.20 time: 0.194973 Sep 02 21:25:56.057226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 191/366] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:55 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:56.125016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:56.125619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:56.132648 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.133132 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.133589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.134323 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.134773 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.135190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.246949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5c36bbdb-215e-4741-b2c4-6efd42daebf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.244742 Sep 02 21:25:56.260702 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 176/367] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:25:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:25:56.300752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.301499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-99e9123e-1f22-45fc-aac9-3d3296844500 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.180216 Sep 02 21:25:56.302117 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 192/368] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:56 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:56.376606 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-880100805", "imageRef": "06ba8e5c-d70d-4b6a-be1b-79bc9754ce18", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1956423974", "networks": [{"uuid": "be09027f-bc46-456b-8d43-1d62c3bb5417"}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:56.439108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] validate_networks() for [('be09027f-bc46-456b-8d43-1d62c3bb5417', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:25:56.897904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:56.898539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:56.901738 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:25:56.902379 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:25:56.902671 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:25:56.903078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:25:56.903491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:25:56.905940 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.906506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.907178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.907793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.908331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.909555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.913524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.914056 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.914815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.915434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:56.915917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:56.916344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:56.934424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Getting quotas for project 2a715e1b8137477b9f39b1d6d8d0d268. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:25:56.938386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Getting quotas for user b0884441f5744f09b23823752684fe08 and project 2a715e1b8137477b9f39b1d6d8d0d268. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:25:56.953532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:25:56.956320 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='06ba8e5c-d70d-4b6a-be1b-79bc9754ce18',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:25:56.989973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:56.999685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-59e3ea27-5c9d-4081-a002-abb8fa064983 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1250 microversion: 2.1 time: 0.105797 Sep 02 21:25:57.000248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 193/369] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:56 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1250 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:57.084164 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:57.084778 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:57.091732 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:57.092230 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:57.092672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:57.093383 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:57.093872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:57.094307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:57.304189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1e7c702c-3b8e-47ae-ad51-4c66bb0fba3a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.931407 Sep 02 21:25:57.305127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 177/370] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:25:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:25:57.322666 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-03dbba82-39ff-4668-ba5f-cb3aa4bfdfac tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:57.323317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-03dbba82-39ff-4668-ba5f-cb3aa4bfdfac tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:57.470484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-03dbba82-39ff-4668-ba5f-cb3aa4bfdfac tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:57.480758 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-03dbba82-39ff-4668-ba5f-cb3aa4bfdfac tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1258 microversion: 2.1 time: 0.168534 Sep 02 21:25:57.481718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 178/371] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:57 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:57.488278 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:57.489671 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:57.497711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:57.498237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:57.498676 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:57.499389 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:57.499849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:57.500270 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:57.572473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:57.584230 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:57.587029 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:57.589107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e07b0dc7-c6fb-417b-b5b9-90d9002bff3a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1721 microversion: 2.20 time: 0.509476 Sep 02 21:25:57.589941 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 194/372] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:57 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1721 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:25:57.728039 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:57.737309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-80f676eb-a9fa-412a-b74d-8bf34e7ca3dd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.253686 Sep 02 21:25:57.737908 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 179/373] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:57 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:58.025481 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:58.026306 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:58.033252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:58.034551 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:58.035043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:58.035757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:58.036216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:58.036820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:58.123161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:58.132400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2d098e3b-c3fe-41f7-bdfc-460bcc871d80 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1250 microversion: 2.1 time: 0.111082 Sep 02 21:25:58.133007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 195/374] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:58 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1250 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:58.508858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-48c6cb28-72a0-42ab-8f54-3e650c1b818a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:58.509499 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-48c6cb28-72a0-42ab-8f54-3e650c1b818a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:58.573635 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-48c6cb28-72a0-42ab-8f54-3e650c1b818a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:58.583051 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-48c6cb28-72a0-42ab-8f54-3e650c1b818a tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1258 microversion: 2.1 time: 0.077986 Sep 02 21:25:58.584217 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 180/375] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:58 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1258 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:58.623334 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:58.623941 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:58.631410 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:58.632146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:58.632707 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:58.633490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:58.633940 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:58.634497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:58.657767 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:25:58.761939 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:58.763992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:58.774390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:58.775314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:58.775993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:58.777108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:58.777783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:58.778560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:58.803574 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:58.817009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:58.818757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:58.820116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7d7e1b9d-292d-486b-a3bd-631431b66025 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1721 microversion: 2.20 time: 0.200866 Sep 02 21:25:58.820683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 196/376] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:58 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:25:58.928369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:58.937621 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-90936cb0-7845-4212-bd6a-568f6833a707 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.180584 Sep 02 21:25:58.938235 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 181/377] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:58 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:59.157523 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:59.158162 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:59.166248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.166901 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.167359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.168069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.168649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.169107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.243579 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:59.249241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bdcbacd3-346b-498c-aac7-4ec08877c8fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1250 microversion: 2.1 time: 0.095700 Sep 02 21:25:59.249816 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 197/378] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:59 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1250 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:25:59.597706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-f7995274-6c30-48ad-b308-537f19a34d9d req-f4d61aef-2294-4095-955e-c0b5f9428f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5852d6-c6ee-489d-a2cd-a1ce7008540f", "name": "network-vif-unplugged", "status": "completed", "tag": "9c460ac1-1f81-408f-907d-b19a443be414"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:25:59.612094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-f7995274-6c30-48ad-b308-537f19a34d9d req-f4d61aef-2294-4095-955e-c0b5f9428f6e service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.612832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-f7995274-6c30-48ad-b308-537f19a34d9d req-f4d61aef-2294-4095-955e-c0b5f9428f6e service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.613554 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-f7995274-6c30-48ad-b308-537f19a34d9d req-f4d61aef-2294-4095-955e-c0b5f9428f6e service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.614239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:59.615153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:59.630044 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.630931 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.631892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.632944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.634165 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.634844 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.647913 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-f7995274-6c30-48ad-b308-537f19a34d9d req-f4d61aef-2294-4095-955e-c0b5f9428f6e service nova] Creating event network-vif-unplugged:9c460ac1-1f81-408f-907d-b19a443be414 for instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f on hv-cinder-85220 Sep 02 21:25:59.658791 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-f7995274-6c30-48ad-b308-537f19a34d9d req-f4d61aef-2294-4095-955e-c0b5f9428f6e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065159 Sep 02 21:25:59.660130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 182/379] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:25:59.727326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:25:59.740106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7417f1ef-537b-48cf-ac74-1ff887285d9b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1262 microversion: 2.1 time: 0.135594 Sep 02 21:25:59.741226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 198/380] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:59 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1262 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:25:59.846375 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:59.847684 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:59.857939 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.858571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.859136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.860093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.860672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.861190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.966461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:25:59.967693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:25:59.977312 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.978052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.978688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:25:59.979424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:25:59.980136 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:25:59.980639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:00.161498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:00.177469 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:00.202005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:00.202005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7e3031c9-ebd5-448c-9add-21a68ffe05e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1721 microversion: 2.20 time: 0.339398 Sep 02 21:26:00.202005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 183/381] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:25:59 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:26:00.224718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:00.238325 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-59092d8b-8897-4ec3-853f-f6b38ff0fb80 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.278981 Sep 02 21:26:00.240266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 199/382] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:25:59 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:00.273561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:00.274216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:00.280482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:00.281110 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:00.281436 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:00.282185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:00.282690 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:00.288737 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:00.350736 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:00.359425 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d34a5b79-71df-4171-a3d0-66ff3f4029c1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1242 microversion: 2.1 time: 0.089729 Sep 02 21:26:00.360343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 184/383] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:00 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:00.765735 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:00.766381 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:00.773834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:00.774345 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:00.774781 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:00.775485 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:00.775942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:00.776366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:00.844839 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:00.853481 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fb9605a1-f045-45b4-90d6-8eec5d35d119 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1310 microversion: 2.1 time: 0.092258 Sep 02 21:26:00.854546 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 200/384] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:00 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:01.215629 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:01.216474 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:01.223707 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.224190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.224683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.225359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.225824 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.226272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.261772 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:01.262535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:01.269868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.270370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.270865 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.272413 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.272874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.273299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.429188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:01.441959 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:01.445084 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:01.447279 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-95573d78-e90b-497d-8646-d9731cedcf59 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1721 microversion: 2.20 time: 0.235595 Sep 02 21:26:01.448184 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 185/385] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:01 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:01.460777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:01.460777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:01.471828 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.471828 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.471828 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.472474 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:01.472580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.472580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.472580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.480263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d91f5b40-3afa-4bce-b338-6ab482f8f80f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.222241 Sep 02 21:26:01.480846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 201/386] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:01 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:01.547166 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:01.557742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ae597784-1b5b-47d3-9c42-cce1642843a0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1298 microversion: 2.1 time: 0.106942 Sep 02 21:26:01.557742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 186/387] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:01 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:01.879343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:01.879969 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:01.886229 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.886721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.887160 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.887863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:01.888316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:01.888738 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:01.959744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:01.969434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-62f09a1d-a432-4f8b-b113-a79b7a68e187 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1310 microversion: 2.1 time: 0.094288 Sep 02 21:26:01.970058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 202/388] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:01 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1310 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:02.474746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:02.475441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:02.482279 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:02.482758 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:02.483243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:02.484015 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:02.484464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:02.484940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:02.508747 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:02.509371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:02.516058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:02.516549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:02.517249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:02.518537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:02.518998 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:02.519422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:02.700039 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:02.709065 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:02.710585 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:02.711897 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7620efc5-1f38-4da1-8075-4b77fe8a649f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1721 microversion: 2.20 time: 0.241235 Sep 02 21:26:02.712321 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 187/389] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:02 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:02.726032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:02.726202 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:02.726202 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:02.726397 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-23beb871-efe0-4e4e-95d9-c9caa41a9eda tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.219646 Sep 02 21:26:02.730299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:02.730299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:02.730299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:02.730599 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:02.730913 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:02.731332 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:02.736733 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 203/390] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:02 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:02.796641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:02.805491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-12edd2a8-ba78-4242-b7f6-a6f7944970d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1298 microversion: 2.1 time: 0.088356 Sep 02 21:26:02.806123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 188/391] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:02 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:02.993511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:03.021720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:03.021720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:03.021720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:03.021720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:03.022830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:03.022830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:03.022830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:03.073170 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:03.081283 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-34a000e8-89e4-413e-9f5f-87242bd4d932 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1310 microversion: 2.1 time: 0.091549 Sep 02 21:26:03.081856 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 204/392] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:02 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1310 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:03.749985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:03.749985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:03.749985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:03.749985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:03.750817 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:03.750817 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:03.750995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:03.751356 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:03.751473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:03.751586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:03.755758 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:03.756251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:03.756694 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:03.757442 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:03.757927 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:03.758359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:04.002149 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:04.007931 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:04.016081 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:04.018222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:04.021744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8dab435a-6f6c-4ed8-a49b-4a480c3c6dd9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1721 microversion: 2.20 time: 0.285300 Sep 02 21:26:04.022003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f67f20ba-e659-4255-a733-69efcf87be96 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.275273 Sep 02 21:26:04.022156 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 189/393] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:03 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1721 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:04.022282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 205/394] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:03 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:04.041207 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:04.041864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:04.049390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:04.050515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:04.051501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:04.051912 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:04.052317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:04.052746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:04.106157 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:04.106900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:04.117408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:04.117977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:04.118447 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:04.119684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:04.120894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:04.120894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:04.142196 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:04.161510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-82a195e8-7622-483a-81cf-13464199116d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1298 microversion: 2.1 time: 0.130320 Sep 02 21:26:04.162496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 190/395] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:04 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1298 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:04.210469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:04.224059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2af7c9a5-a809-495e-8518-3d9b90867178 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1310 microversion: 2.1 time: 0.121919 Sep 02 21:26:04.225261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 206/396] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:04 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1310 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:05.048106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:05.049381 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:05.050392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:05.052098 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:05.054809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:05.060771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.061647 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.062434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.063955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.064744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.065434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.067941 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.068549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.069004 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.069734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.070233 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.070853 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.336162 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:05.340588 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:05.347274 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-20f486a3-01a9-4d1e-90f3-1d8e2c8acbf0 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1698 microversion: 2.1 time: 0.302687 Sep 02 21:26:05.349072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 207/397] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:05 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1698 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:05.361686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:05.361686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:05.371428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:05.373547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:05.374977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fbb612c5-a3dd-4998-86c1-20aa8256aeed tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1724 microversion: 2.20 time: 0.332002 Sep 02 21:26:05.379025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.380474 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.381213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.382324 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 191/398] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:05 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:26:05.382888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.383883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.384801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.395837 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:05.396522 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:05.416701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.416701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.416701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.416701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.422881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.423825 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.542254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:05.553631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4e89482c-175f-4a3c-8d0a-960cacd812fe tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1316 microversion: 2.1 time: 0.202636 Sep 02 21:26:05.554632 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 208/399] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:05 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:05.564746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b4785606-3c25-46de-bdb9-ea5f65a0661a tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:05.572643 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b4785606-3c25-46de-bdb9-ea5f65a0661a tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.573979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b4785606-3c25-46de-bdb9-ea5f65a0661a tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.574817 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b4785606-3c25-46de-bdb9-ea5f65a0661a tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.589909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:05.610779 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1924f9a4-dc01-4be9-b7be-092d03defc15 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1318 microversion: 2.1 time: 0.218804 Sep 02 21:26:05.616571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 192/400] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:05 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:05.621918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b4785606-3c25-46de-bdb9-ea5f65a0661a tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Going to try to start instance {{(pid=121512) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 21:26:05.631188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ac08439-45a1-4c8e-a52d-08ef81bb0e37"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:05.634719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:05.648785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.649449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.650008 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.650799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:05.652423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:05.652423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:05.997615 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b4785606-3c25-46de-bdb9-ea5f65a0661a tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/action" status: 202 len: 0 microversion: 2.1 time: 0.441398 Sep 02 21:26:05.998370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 209/401] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:26:05 2022] POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:26:06.004322 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:06.011288 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:06.018348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:06.018924 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:06.019565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:06.020293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:06.020873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:06.021310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:06.208617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lazy-loading 'services' on Instance uuid 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:26:06.673143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8d847035-5c86-40c4-955e-5973749c5391 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3/os-volume_attachments/c00a948b-6d8e-414c-903a-76953f0406e2" status: 202 len: 0 microversion: 2.1 time: 0.673196 Sep 02 21:26:06.673742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 210/402] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:26:05 2022] DELETE /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3/os-volume_attachments/c00a948b-6d8e-414c-903a-76953f0406e2 => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:26:06.681692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:06.682666 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:06.691115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:06.692192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:06.692853 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:06.693800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:06.694517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:06.695783 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:06.723434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:06.791002 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:06.865460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:06.874612 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ed4e366d-3651-4924-9abf-431582f81303 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1707 microversion: 2.1 time: 0.198833 Sep 02 21:26:06.875494 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 211/403] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:06 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1707 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:06.881057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:06.881677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:06.894252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:06.894252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:06.894252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:06.894252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:06.895026 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:06.895113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:06.926238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=4 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:07.566936 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:07.575108 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e49b898e-15a3-4e88-b6b7-a16a34f5cf3c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.698357 Sep 02 21:26:07.576517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 212/404] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:06 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:07.599204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:07.600089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:07.606843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:07.608209 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:07.608817 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:07.609706 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:07.610351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:07.610992 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:07.695971 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7d082899-52e6-48c7-9710-fca3a18c287d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.078119 Sep 02 21:26:07.696968 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 193/405] 10.222.0.79 () {62 vars in 1364 bytes} [Fri Sep 2 21:26:05 2022] POST /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments => generated 188 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:26:07.703579 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-913489439", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-261479926", "security_groups": [{"name": "tempest-secgroup-smoke-203437446"}], "block_device_mapping_v2": [{"uuid": "555f9127-9ece-4577-ba4e-33206ad78c78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "114c3cb0-28e2-4cd4-ac62-ba9797320ab1"}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:07.823692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:07.840679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b890e6dc-7080-499e-9fbc-1c3d99bb3e27 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.249284 Sep 02 21:26:07.842303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 213/406] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:07 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:07.925295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:07.928177 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:07.937136 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:07.937742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:07.938365 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:07.939230 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:07.939981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:07.941038 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:08.119591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] validate_networks() for [('114c3cb0-28e2-4cd4-ac62-ba9797320ab1', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:26:08.240909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:08.250104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-04077c4a-06c9-415f-b249-1bd550bb529e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1707 microversion: 2.1 time: 0.341347 Sep 02 21:26:08.265855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 214/407] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:07 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1707 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:08.266180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:08.267070 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:08.275667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:08.276569 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:08.277193 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:08.285410 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:08.286653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:08.287190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:08.352918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121512) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 21:26:08.579062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=24 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:08.873891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-77b00fc7-da32-4959-8cbd-ea0fe01e1908 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/action" status: 202 len: 0 microversion: 2.20 time: 0.610583 Sep 02 21:26:08.881723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 215/408] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Sep 2 21:26:08 2022] POST /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:26:08.886215 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:08.886840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:08.900558 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:08.903697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:08.904980 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:08.904980 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:08.907493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:08.908041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:08.908486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.012712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:10.030434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5f3a9aa0-adfd-4a49-9264-5aeb29717384 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 1.147867 Sep 02 21:26:10.031149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 216/409] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:08 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:10.041733 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:10.059452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:10.059452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.059452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.059452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.059811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.059811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.059811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.081966 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:26:10.083979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:26:10.085118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:26:10.086099 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:26:10.087119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:26:10.124131 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.125568 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.126530 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.133130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.133963 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.136909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.163553 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:10.185426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Getting quotas for project d0d9b4769b124ec69714a30d02bb8557. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:26:10.213161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Getting quotas for user e2940758d8424054bf3a68a42b79bb81 and project d0d9b4769b124ec69714a30d02bb8557. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:26:10.346156 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:26:10.346156 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='555f9127-9ece-4577-ba4e-33206ad78c78',volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:26:10.478938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:10.488176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-909d5b8f-e76c-438b-8348-ba8a6dc055d4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.455712 Sep 02 21:26:10.488767 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 217/410] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:10 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:10.494685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:10.495293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:10.504073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.504574 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.505040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.506017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.506680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.507113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.692220 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:10.705221 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:10.707919 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:10.710196 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8ee16194-a971-4061-90c5-e4e6e1b2e6af tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1750 microversion: 2.20 time: 0.219668 Sep 02 21:26:10.714109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 218/411] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:10 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1750 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:10.719082 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:10.719783 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:10.728906 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.729507 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.730878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:10.731752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:10.732494 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:10.733039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:11.271068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9cc3420e-b5fa-4740-b375-20f4da700769 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.572828 Sep 02 21:26:11.273005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 194/412] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:26:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 3576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:26:11.279418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:11.280451 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:11.304354 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:11.305944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:11.308292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:11.310916 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:11.311677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:11.313512 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:11.610572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:11.624720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a2b267ec-2458-43a3-8897-a4fff36afbd2 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1711 microversion: 2.1 time: 0.905632 Sep 02 21:26:11.626949 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 219/413] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:10 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1711 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:11.643387 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4cc74acc-fddf-4aec-8abb-473d4adf1735 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:11.647959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4cc74acc-fddf-4aec-8abb-473d4adf1735 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:11.848019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4cc74acc-fddf-4aec-8abb-473d4adf1735 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:11.854333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4cc74acc-fddf-4aec-8abb-473d4adf1735 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1093 microversion: 2.1 time: 0.223330 Sep 02 21:26:11.854967 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 220/414] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:11 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1093 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:11.868280 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:11.868900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:11.884601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:11.885106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:11.885549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:11.890654 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:11.891459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:11.891917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:11.979651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:11.989780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-74ae856a-b9b0-4cd6-9058-4f3ad1112c8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.715181 Sep 02 21:26:11.991597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 195/415] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:11 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:11.998181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:11.999134 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:12.018536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.022257 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.023216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.027129 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.028042 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.028720 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.408405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:12.429904 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:12.443795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:12.445966 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:12.447891 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-86d16922-ee86-48ba-b81e-b73dd1efd1c2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1750 microversion: 2.20 time: 0.454695 Sep 02 21:26:12.449039 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 196/416] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:11 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1750 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:12.451941 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bcbcafb7-808f-47d9-8f03-41508be6cbe7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.583368 Sep 02 21:26:12.456440 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 221/417] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:11 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:12.481526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-915fd2a2-a993-4442-9ba0-b29cda843ac2 req-40c8bedb-b0d1-445e-b465-be561aba543a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06870d3d-d4b2-4493-b4a9-c6e33f1824be", "tag": "737355df-9df5-464b-b327-d997ff9abc7a"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:12.493072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-915fd2a2-a993-4442-9ba0-b29cda843ac2 req-40c8bedb-b0d1-445e-b465-be561aba543a service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.493615 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-915fd2a2-a993-4442-9ba0-b29cda843ac2 req-40c8bedb-b0d1-445e-b465-be561aba543a service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.494095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-915fd2a2-a993-4442-9ba0-b29cda843ac2 req-40c8bedb-b0d1-445e-b465-be561aba543a service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.508961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-915fd2a2-a993-4442-9ba0-b29cda843ac2 req-40c8bedb-b0d1-445e-b465-be561aba543a service nova] Creating event network-changed:737355df-9df5-464b-b327-d997ff9abc7a for instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be on hv-cinder-85220 Sep 02 21:26:12.515583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-915fd2a2-a993-4442-9ba0-b29cda843ac2 req-40c8bedb-b0d1-445e-b465-be561aba543a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064581 Sep 02 21:26:12.516825 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 197/418] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:12.802056 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:12.802615 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:12.813668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.823259 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.823259 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.827719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:12.828473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:12.829472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:12.887656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-75b9f8b2-f2d6-4c3a-824e-ad8e04f1de58 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:12.888768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-75b9f8b2-f2d6-4c3a-824e-ad8e04f1de58 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:12.921782 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:26:13.239785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-75b9f8b2-f2d6-4c3a-824e-ad8e04f1de58 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:13.260118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-75b9f8b2-f2d6-4c3a-824e-ad8e04f1de58 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1093 microversion: 2.1 time: 0.378455 Sep 02 21:26:13.264520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 198/419] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:12 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1093 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:13.272764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:13.279391 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:13.305845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:13.311856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:13.312701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:13.313921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:13.314792 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:13.316384 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:13.905560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:13.920424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9d5c3693-b021-4725-9afc-3a1e156c36d5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.653728 Sep 02 21:26:13.937289 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 199/420] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:13 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:13.950253 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:13.951403 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:13.960418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:13.961122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:13.961961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:13.963079 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:13.963752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:13.964336 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.274405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:14.283889 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:14.286159 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:14.287784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-772ab35d-09ac-440b-b83e-cda2cce8983f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1750 microversion: 2.20 time: 0.348762 Sep 02 21:26:14.289017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 200/421] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:13 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1750 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:14.294398 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:14.295489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:14.305985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.307023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.307698 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.309242 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.309997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.310782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.437267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e28561da-4b7e-457e-8687-30cd3fff30a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 204 len: 0 microversion: 2.1 time: 1.649164 Sep 02 21:26:14.438986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 222/422] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:26:12 2022] DELETE /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 0 bytes in 1652 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:26:14.458123 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8635b71a-d455-4da7-9131-4b461d555501 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:14.459328 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8635b71a-d455-4da7-9131-4b461d555501 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:14.515231 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:14.525944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2fe24ed0-0d48-4187-9ff6-c1e2275dc414 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.235404 Sep 02 21:26:14.539761 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 201/423] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:14 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:14.556094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:14.557835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:14.570873 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.571785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.572458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.574414 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.575730 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.576783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.610171 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8635b71a-d455-4da7-9131-4b461d555501 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:14.638851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8635b71a-d455-4da7-9131-4b461d555501 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1093 microversion: 2.1 time: 0.197051 Sep 02 21:26:14.654899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 223/424] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:14 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1093 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:14.665349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-f74f3eeb-2ba1-48c8-9e65-464e7dc0a974 req-a03725c3-4b30-4645-a770-4731db30ad2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "febb8d4c-5149-4e92-9363-4e502f0c1a6d", "tag": "a26f03e8-5797-4109-a4cb-c033343e086e"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:14.675251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-f74f3eeb-2ba1-48c8-9e65-464e7dc0a974 req-a03725c3-4b30-4645-a770-4731db30ad2a service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.676822 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-f74f3eeb-2ba1-48c8-9e65-464e7dc0a974 req-a03725c3-4b30-4645-a770-4731db30ad2a service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.677566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-f74f3eeb-2ba1-48c8-9e65-464e7dc0a974 req-a03725c3-4b30-4645-a770-4731db30ad2a service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.690613 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-f74f3eeb-2ba1-48c8-9e65-464e7dc0a974 req-a03725c3-4b30-4645-a770-4731db30ad2a service nova] Creating event network-changed:a26f03e8-5797-4109-a4cb-c033343e086e for instance febb8d4c-5149-4e92-9363-4e502f0c1a6d on hv-cinder-85220 Sep 02 21:26:14.696900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-f74f3eeb-2ba1-48c8-9e65-464e7dc0a974 req-a03725c3-4b30-4645-a770-4731db30ad2a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040641 Sep 02 21:26:14.697735 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 224/425] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:14.818656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:14.829078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-56728e62-e0cd-4a72-b212-5fdf4a3281b6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1514 microversion: 2.1 time: 0.288107 Sep 02 21:26:14.837909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 202/426] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:14 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1514 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:14.958287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:14.959319 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:14.968235 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.968959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.969693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:14.971436 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:14.972111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:14.972721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.142544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:15.151488 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-97e89c49-3ccf-4351-9609-6438b5d3e360 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.197790 Sep 02 21:26:15.152342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 225/427] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:14 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:15.315934 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:15.317337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:15.328043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:15.328860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:15.329497 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.331204 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:15.332086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:15.332516 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.558255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:15.559743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:15.562774 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:15.572051 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:15.572672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:15.573124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.573919 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:15.574374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:15.580110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.582016 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:15.583967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:15.585423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5ea3b221-d78e-4d75-8742-572a7748535c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.273852 Sep 02 21:26:15.604597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 203/428] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:15 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:15.667026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:15.667876 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:15.674753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:15.675534 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:15.682250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:15.687186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:15.688067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:15.688977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.028504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.043789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fd39301a-18fa-4ea8-9a56-ed7110adf59e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1143 microversion: 2.1 time: 0.376323 Sep 02 21:26:16.043789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 204/429] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:15 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1143 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:16.045519 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:16.046303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:16.053032 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.053762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.054373 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.055547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.056184 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.056748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.262194 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.272316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ea11faaa-beb8-4999-b67e-0e8c0ad9543f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.719890 Sep 02 21:26:16.278003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 226/430] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:15 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:16.284407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:16.285905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:16.295905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.296405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.296851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.297614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.298103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.298533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.330667 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.347364 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ee991bf3-d014-4ea8-8edc-4898e56e6247 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1514 microversion: 2.1 time: 0.306482 Sep 02 21:26:16.361980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 205/431] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:16 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:16.560359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.560359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9f43d38e-ce04-4f39-bf72-3b082497af49 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.280728 Sep 02 21:26:16.561109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 227/432] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:16 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:16.611459 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:16.623550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:16.623550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.623550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.623550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.624089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:16.624089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:16.624089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:16.806835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.818767 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.826674 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:16.828014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-699a7485-af47-4ef1-8f46-9b4cd3afb47f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.220652 Sep 02 21:26:16.829889 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 206/433] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:16 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:17.071014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:17.071718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:17.078466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.078809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.079732 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.080865 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.081933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.082479 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.106807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:17.170072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:17.179128 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c2a86323-1b64-47b3-b862-69cb6b8ef398 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1143 microversion: 2.1 time: 0.112147 Sep 02 21:26:17.179833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 228/434] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:17 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1143 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:17.298105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:17.298811 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:17.306744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.311973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.311973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.311973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.311973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.312394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.377455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:17.378038 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:17.385283 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.385583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.386208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.387215 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.388099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.388857 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.561113 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:17.571803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9b3b0c0a-62ad-49b8-bc7a-c890531b46da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.277753 Sep 02 21:26:17.582783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 207/435] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:17 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:17.585155 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:17.586031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:17.594092 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.594786 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.595424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.596769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.597498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.597971 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.634740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:17.644915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3cb959c5-f2fb-435a-884a-018af360ac87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1514 microversion: 2.1 time: 0.271453 Sep 02 21:26:17.645989 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 229/436] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:17 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1514 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:17.820930 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:17.829477 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f3985360-df5b-4c12-a4f8-250fca36fe85 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.248040 Sep 02 21:26:17.831558 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 208/437] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:17 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:17.863533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:17.864167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:17.870865 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.871351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.871790 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:17.872672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:17.873260 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:17.874375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.039775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:18.050715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:18.052588 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:18.053882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d3b32853-5142-477a-abec-c2a4e0d3c319 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.194548 Sep 02 21:26:18.065981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 230/438] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:17 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:26:18.204771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:18.205847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:18.212636 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.213097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.213535 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.214456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.214919 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.215459 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.284491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:18.295056 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d842d677-8e2f-4d69-a56e-98ccc9ab11ab tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1143 microversion: 2.1 time: 0.094213 Sep 02 21:26:18.295976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 209/439] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:18 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:18.597357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:18.597995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:18.604976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.605455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.605908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.606605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.607051 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.607469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.670902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:18.672237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:18.680265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.680939 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.681378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.682189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.682716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.683216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.808073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:18.816639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-90857d3e-8cb7-49cf-aceb-3b7f7fcf9b63 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.223880 Sep 02 21:26:18.817621 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 231/440] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:18 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:18.861543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:18.862734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:18.863277 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:18.873758 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.874591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.875579 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.876741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:18.878162 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:18.878311 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-966e9e50-3625-4b62-8652-765a3ba169bd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1514 microversion: 2.1 time: 0.211274 Sep 02 21:26:18.878913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:18.879442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 210/441] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:18 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:19.020769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:19.028863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a058cbfb-40e9-4e3b-92e3-574d6368b30f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.175749 Sep 02 21:26:19.029370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 232/442] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:18 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:19.081781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:19.082438 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:19.088615 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.089094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.089562 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.090300 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.090754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.091176 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.248751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:19.253114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:19.259105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:19.260567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:19.261733 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-39539a43-d6ce-4ccd-9201-b68f3686ff0e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.184878 Sep 02 21:26:19.262322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 211/443] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:19 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:19.320669 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:19.321297 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:19.327426 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.327916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.328354 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.329048 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.329501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.329970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.403753 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:19.412854 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f49285a3-880d-4a7c-b6fa-b3a3ef500686 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1143 microversion: 2.1 time: 0.095965 Sep 02 21:26:19.413424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 233/444] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:19 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1143 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:19.840756 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:19.841322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:19.848800 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.849291 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.849735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.850472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.850958 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.851390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.906280 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:19.906965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:19.914696 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.915198 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.915642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:19.916410 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:19.916874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:19.917313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.033145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.042237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6b95f929-ff9a-458b-a73f-2a1324710334 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.205303 Sep 02 21:26:20.042821 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 212/445] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:19 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:20.052653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:20.053455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:20.059894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:20.060383 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:20.060823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.061528 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:20.062026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:20.062448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.094041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.103149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ceb8623f-fea3-4e10-b0cf-092473b7d2c0 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1514 microversion: 2.1 time: 0.201277 Sep 02 21:26:20.103836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 234/446] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:19 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:20.161235 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:20.207632 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.215492 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-14955bd9-dfd8-4f88-aeac-0a0b406db69a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.166757 Sep 02 21:26:20.216068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 213/447] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:20 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:20.288458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:20.289066 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:20.295264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:20.295751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:20.296183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.296876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:20.297326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:20.297735 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.444474 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:20.445957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:20.454971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.459679 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:20.460510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:20.461090 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.462287 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:20.463130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:20.463842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:20.471749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.473376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.474681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1b5b673f-0668-47a4-82cc-bd4201e0241f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.190505 Sep 02 21:26:20.475344 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 235/448] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:20 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:20.531620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:20.539559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ae24a462-82af-41b6-8c55-098ddb91d521 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1143 microversion: 2.1 time: 0.105850 Sep 02 21:26:20.540123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 214/449] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:20 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1143 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:20.748017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-237727345", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "networks": [{"uuid": "5c60687e-6e60-428e-90d1-ab016d49d787"}]}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:20.805652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.network.neutron [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] validate_networks() for [('5c60687e-6e60-428e-90d1-ab016d49d787', None, None, None, None, None)] {{(pid=121512) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:26:21.069994 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:21.070632 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:21.079869 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.080881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.083285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.083285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.083285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.083285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.274112 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Flavor limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:26:21.274593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Image limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:26:21.275105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Flavor pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:26:21.275664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Image pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:26:21.276253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:26:21.286562 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.287047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.287506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.288271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.288680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.289147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.298901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:21.307306 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Getting quotas for project 00fbc2e7b83e496c9db6e8b0601ec81d. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:26:21.307530 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b77d8c35-a80e-4a98-a12f-dee4ab34e806 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.244558 Sep 02 21:26:21.308418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 215/450] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:21 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:21.312193 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Getting quotas for user f99376abecf24499b39dacbc7926e8c0 and project 00fbc2e7b83e496c9db6e8b0601ec81d. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:26:21.313796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:21.314523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:21.320973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.321460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.322107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.322827 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.324988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Going to run 1 instances... {{(pid=121512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:26:21.325766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.326653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.327643 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:26:21.558272 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-75d46b50-0a2a-4889-bb0f-8ce60438c94e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813999 Sep 02 21:26:21.565223 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 236/451] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:26:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:26:21.570928 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:21.571563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:21.584935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.584935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.584935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.584935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.585580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.585580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.588964 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:21.603431 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-430b8bfb-f24a-4ac3-9df0-4b716748f9a4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1514 microversion: 2.1 time: 0.293216 Sep 02 21:26:21.604125 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 216/452] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:21 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:21.619670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:21.620325 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:21.627787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.628422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.628937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.629799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.630346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.630928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.967154 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:21.975250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ad18c6d1-340c-482a-85bb-e1e1a90d980d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.408425 Sep 02 21:26:21.975826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 237/453] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:21 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:21.980943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:21.981541 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:21.988760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.989377 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.989697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:21.990857 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:21.991034 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:21.991462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.001762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.023709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.023709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.023709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f9853652-4c96-4292-9e9b-1ff4a95c4028 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.412878 Sep 02 21:26:22.024138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 217/454] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:21 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:22.024138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0c6dda52-4b51-4321-b49a-9905208a7bde tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:22.024138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0c6dda52-4b51-4321-b49a-9905208a7bde tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:22.070689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.079176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a8125937-aa87-47fa-bb51-57199ac0000c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1143 microversion: 2.1 time: 0.101882 Sep 02 21:26:22.080027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 238/455] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:21 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1143 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:22.097203 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0c6dda52-4b51-4321-b49a-9905208a7bde tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.104586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0c6dda52-4b51-4321-b49a-9905208a7bde tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1213 microversion: 2.1 time: 0.084831 Sep 02 21:26:22.105169 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 218/456] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:22 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:22.330002 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:22.330666 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:22.336708 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:22.337205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:22.337642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.338378 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:22.338838 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:22.339272 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.497305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.505919 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-34461c12-d664-4f7f-9256-8bbf21c1f342 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.179767 Sep 02 21:26:22.506451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 239/457] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:22 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:22.647362 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:22.647982 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:22.654978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:22.655472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:22.655914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.656619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:22.657077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:22.657507 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:22.793170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:22.803638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b305baae-e161-42ff-be3c-f6f2c1bd7019 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1514 microversion: 2.1 time: 0.160003 Sep 02 21:26:22.804500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 219/458] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:22 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:23.001857 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:23.002538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:23.009254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.010027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.010468 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.011358 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.012183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.012395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.047283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:23.048207 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:23.055613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.056099 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.056565 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.057280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.059157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.059858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.342688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.351307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-34781c31-9247-4dd7-a83d-dd27430323ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.354314 Sep 02 21:26:23.351942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 240/459] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:22 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:23.356717 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:23.357435 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:23.364700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.365183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.365614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.366536 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.366984 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.367402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.372105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.382162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.384192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.385643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a038a5cd-c7f3-48de-b5e3-7fc25ec2ba46 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.342595 Sep 02 21:26:23.386352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 220/460] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:23 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:26:23.400670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a68cec9b-9f6a-4d29-b847-2d6d797cff1c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:23.402016 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a68cec9b-9f6a-4d29-b847-2d6d797cff1c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:23.484486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.494473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ef58d585-1922-4f43-a130-b1438d5e3311 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1191 microversion: 2.1 time: 0.141435 Sep 02 21:26:23.495053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 241/461] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:23 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1191 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:23.505466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a68cec9b-9f6a-4d29-b847-2d6d797cff1c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.513329 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a68cec9b-9f6a-4d29-b847-2d6d797cff1c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1213 microversion: 2.1 time: 0.125711 Sep 02 21:26:23.514020 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 221/462] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:23 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1213 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:23.529344 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:23.530263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:23.536688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.537188 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.537641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.538419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.538879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.539311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.677381 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.685879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bdcd9071-5740-4e87-9b1e-032e7998941d tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.160850 Sep 02 21:26:23.686462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 242/463] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:23 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:23.828414 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:23.828934 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:23.835897 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.836387 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.836821 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.837529 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:23.838013 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:23.838440 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:23.985787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:23.994752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6bf2c8e1-b07e-4f99-807d-43e1948ef262 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1514 microversion: 2.1 time: 0.170246 Sep 02 21:26:23.995334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 222/464] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:23 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:24.071760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-81586c28-0bd1-4a25-badf-261ff7987f4a req-366c1edb-f5d3-4a6b-a364-569139f7f1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ba005ca-8059-46ef-bcaa-3b543cdfa6f3", "name": "network-vif-deleted", "tag": "c93c7163-1b06-42a9-bf19-914550a78cf5"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:24.082182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-81586c28-0bd1-4a25-badf-261ff7987f4a req-366c1edb-f5d3-4a6b-a364-569139f7f1b9 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.082576 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-81586c28-0bd1-4a25-badf-261ff7987f4a req-366c1edb-f5d3-4a6b-a364-569139f7f1b9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.083032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-81586c28-0bd1-4a25-badf-261ff7987f4a req-366c1edb-f5d3-4a6b-a364-569139f7f1b9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.096001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-81586c28-0bd1-4a25-badf-261ff7987f4a req-366c1edb-f5d3-4a6b-a364-569139f7f1b9 service nova] Creating event network-vif-deleted:c93c7163-1b06-42a9-bf19-914550a78cf5 for instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 on hv-cinder-85220 Sep 02 21:26:24.101383 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-81586c28-0bd1-4a25-badf-261ff7987f4a req-366c1edb-f5d3-4a6b-a364-569139f7f1b9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033309 Sep 02 21:26:24.102058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 243/465] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:24.377833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:24.379185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:24.396283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.396783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.397458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.398481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.398942 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.399636 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.419677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:24.420861 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:24.431903 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.433146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.433864 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.435104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.435860 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.436674 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.603298 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:24.612970 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9332bfe8-3456-4f83-b59e-a27c214c0968 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.239940 Sep 02 21:26:24.625066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 223/466] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:24 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:24.631947 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:24.632968 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:24.639407 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.640502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.640936 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.641758 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.642549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.643209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.672154 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:24.682397 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:24.683860 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:24.685102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7a4dd7b1-6ffb-4cc0-975f-d271e15ccd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.271952 Sep 02 21:26:24.709465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 244/467] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:24 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:24.715349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:24.716477 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:24.724991 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.725510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.725790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:24.725981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.726896 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.727351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.727942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.734565 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-967782b7-7748-4e38-9004-b88686e9a048 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1191 microversion: 2.1 time: 0.109802 Sep 02 21:26:24.735148 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 224/468] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:24 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1191 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:24.742596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:24.743714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:24.752835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.753328 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.753762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.754511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:24.754968 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:24.755394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:24.821424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:24.829936 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c53acfa2-9b10-47b1-9798-19188fbb89e8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1217 microversion: 2.1 time: 0.118742 Sep 02 21:26:24.831836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 245/469] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:24 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:24.918124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:24.926864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2b11fa71-b701-4988-b370-caeb059be85e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.189378 Sep 02 21:26:24.927432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 225/470] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:24 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:25.019152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:25.019885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:25.026219 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.026710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.027148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.027853 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.028376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.028809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.032013 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:25.105520 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:25.114968 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9651588c-b27c-4ec1-8ff3-6f2fe5a54a7a tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1304 microversion: 2.1 time: 0.100929 Sep 02 21:26:25.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 246/471] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:25 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:25.639072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:25.639719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:25.647239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.647796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.648318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.648943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.649405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.649879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.715617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:25.716381 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:25.724075 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.724651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.725291 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.728358 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.728358 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.728358 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.832672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:25.842515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4c263c92-67f2-4d86-ac05-a35e8c72b10d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.206759 Sep 02 21:26:25.861849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 226/472] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:25 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:25.861849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:25.861849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:25.875448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.875946 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.876424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.877500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.878160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.878989 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.884111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:25.894326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:25.895913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:25.897151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d75dd8cb-cd19-41d0-b798-b0c72af3d698 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1752 microversion: 2.20 time: 0.185519 Sep 02 21:26:25.897777 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 247/473] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:25 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:25.902642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:25.902965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:25.910257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.913665 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.913665 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.913665 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.913665 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.914099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.951250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:25.960662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-89d97106-6ca5-40ff-a49c-2f0ab28b0dfb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1199 microversion: 2.1 time: 0.115241 Sep 02 21:26:25.960982 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 227/474] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:25 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1199 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:25.966064 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:25.966721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:25.974265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.974733 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.975391 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.976125 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:25.976536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:25.976955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:25.979601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:25.988564 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-61e8d97a-8d9a-4755-a037-9c63931d4d8a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1209 microversion: 2.1 time: 0.089648 Sep 02 21:26:25.989802 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 248/475] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:25 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:26.123937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:26.132623 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4176412e-8cc4-4c6e-9f06-d44652111eb4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.170573 Sep 02 21:26:26.133200 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 228/476] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:25 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:26.144199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:26.144915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:26.153297 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.154154 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.154635 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:26.155348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.155872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.156342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:26.194254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.194744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.195178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:26.195815 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lazy-loading 'fault' on Instance uuid 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:26:26.238157 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:26.247238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fc042957-e208-4677-8793-2fae25cb1a35 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 200 len: 1309 microversion: 2.1 time: 0.107921 Sep 02 21:26:26.248138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 249/477] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:26 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:26.881672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:26.882338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:26.889047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.889537 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.890271 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:26.890972 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.891428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.891865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:26.927929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:26.930205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:26.942030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.942516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.944417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:26.945625 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:26.947151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:26.948368 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.223312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:27.227754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:27.238684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:27.239675 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1bcd9a1e-b42e-475c-aff3-47bb51a93637 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.361953 Sep 02 21:26:27.240710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:27.240852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 229/478] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:26 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:27.242310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d58edcd9-7b1b-45bd-be9b-6074dc746aa5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.318840 Sep 02 21:26:27.243259 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 250/479] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:26 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:27.245683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:27.246368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:27.248148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:27.248979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:27.255549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.256280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.256986 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.258180 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.258642 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.259264 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.260781 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.261356 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.261888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.278383 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.278752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.279520 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.290603 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:27.623056 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:27.634361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0c76ed89-53db-49d9-a00c-f240ab431d03 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1209 microversion: 2.1 time: 0.392275 Sep 02 21:26:27.635193 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 230/480] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:27 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1209 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:27.644273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:27.656511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7c4165a3-85e9-4e79-bbb0-2b74b5f76ca8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1265 microversion: 2.1 time: 0.409832 Sep 02 21:26:27.658158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:27.658544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 251/481] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:27 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1265 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:27.659227 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:27.664082 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:27.665022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:27.671786 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.672343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.672977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.674703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.675323 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.675844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.685130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.685130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.685130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.685130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:27.685489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:27.685489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:27.724405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] HTTP exception thrown: Instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 could not be found. Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Request method failure captured: Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 HTTP/1.1 Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnRxJyovjMshN4771B_Vtr34GUjWDWGzvSk-deexXkX0GaxN530AKdafF0s7SAE15RK2tf4hgKw_rl_EZV2XaTE9IjIfVAU3fw3DujKuJHFStIgA4a0gxFUq6NgpDv-DtNKy4oOq6bGRuarh67se5Ib5QVY-rgGGsiaC4WNSInEcaJI Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 5f6a7d90bafa459f8a24d89a10132b78 Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1187457843 Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:26:27.730444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5f6a7d90bafa459f8a24d89a10132b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5f6a7d90bafa459f8a24d89a10132b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5f6a7d90bafa459f8a24d89a10132b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5f6a7d90bafa459f8a24d89a10132b78"}]}] Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesSnapshotTestJSON-1187457843 Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 5f6a7d90bafa459f8a24d89a10132b78 Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1187457843 Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesSnapshotTestJSON-1187457843-project Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: 7431e8c106ba4e2689c0aa1001bbafe7 Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesSnapshotTestJSON-1187457843-project Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 could not be found. Sep 02 21:26:27.731908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '6ba005ca-8059-46ef-bcaa-3b543cdfa6f3'} Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 could not be found. Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:26:27.732618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 could not be found. Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 could not be found. Sep 02 21:26:27.733845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:26:27.737908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Returning 404 to user: Instance 6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:26:27.739073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1410bce9-4048-4a7e-a8c0-5f7b57da7829 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3" status: 404 len: 111 microversion: 2.1 time: 0.078843 Sep 02 21:26:27.739830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 252/482] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:27 2022] GET /compute/v2.1/servers/6ba005ca-8059-46ef-bcaa-3b543cdfa6f3 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:26:27.914979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:27.930358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a4e6109e-921c-40f5-8ae2-e5c16d8d75d2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.291374 Sep 02 21:26:27.931183 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 231/483] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:27 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:28.267190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:28.268554 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:28.280236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:28.286462 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:28.288010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:28.292382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.294320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.295496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.296063 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.296348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.296937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.297861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.298686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.299310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.299875 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.300445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.300845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.834646 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:28.844029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:28.848266 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:28.848622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-48067a4e-a197-426a-913f-07fbef7d6055 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.569103 Sep 02 21:26:28.849260 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 232/484] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:28 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:28.853730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:28.854798 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:28.855418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:28.863411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.864230 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.864870 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.868199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.868877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.869502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.872926 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-05e49f6c-5c7a-4cbd-a77a-7675eeb250dd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.610512 Sep 02 21:26:28.885988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 253/485] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:28 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:28.885988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:28.885988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:28.891514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.891514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.891514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:28.891514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:28.892645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:28.892893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.025317 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:29.034335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e00d2577-230b-49d1-a704-1effe0df389d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1283 microversion: 2.1 time: 0.158855 Sep 02 21:26:29.034942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 254/486] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:28 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1283 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:29.040102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-a8cd1040-1a37-4efe-b551-f9ea91cff263 req-f3573a95-6e09-4cf9-960a-629d4b14015f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "febb8d4c-5149-4e92-9363-4e502f0c1a6d", "name": "network-vif-plugged", "status": "completed", "tag": "a26f03e8-5797-4109-a4cb-c033343e086e"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:29.050990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a8cd1040-1a37-4efe-b551-f9ea91cff263 req-f3573a95-6e09-4cf9-960a-629d4b14015f service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.051458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a8cd1040-1a37-4efe-b551-f9ea91cff263 req-f3573a95-6e09-4cf9-960a-629d4b14015f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.051952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a8cd1040-1a37-4efe-b551-f9ea91cff263 req-f3573a95-6e09-4cf9-960a-629d4b14015f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.064451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-a8cd1040-1a37-4efe-b551-f9ea91cff263 req-f3573a95-6e09-4cf9-960a-629d4b14015f service nova] Creating event network-vif-plugged:a26f03e8-5797-4109-a4cb-c033343e086e for instance febb8d4c-5149-4e92-9363-4e502f0c1a6d on hv-cinder-85220 Sep 02 21:26:29.069395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-a8cd1040-1a37-4efe-b551-f9ea91cff263 req-f3573a95-6e09-4cf9-960a-629d4b14015f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033280 Sep 02 21:26:29.070270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 255/487] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:29.077965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:29.078724 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:29.086453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.086950 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.087455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.088524 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.089056 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.089599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.279308 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:29.292214 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-175b4a56-c498-44f3-9926-ce5fb0ed7531 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1276 microversion: 2.1 time: 0.441375 Sep 02 21:26:29.293602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 233/488] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:28 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1276 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:29.300359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-fc546fcb-530c-4cd0-87e3-6e1a873b696f req-3f54f901-6cef-4f26-ae5f-89f406aa5f0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "388a2bcc-b930-4062-9ab7-e611f34dc102", "tag": "648c20bd-32e2-430a-a5cb-c0a728e71c74"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:29.313910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-fc546fcb-530c-4cd0-87e3-6e1a873b696f req-3f54f901-6cef-4f26-ae5f-89f406aa5f0f service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.314709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-fc546fcb-530c-4cd0-87e3-6e1a873b696f req-3f54f901-6cef-4f26-ae5f-89f406aa5f0f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.315419 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-fc546fcb-530c-4cd0-87e3-6e1a873b696f req-3f54f901-6cef-4f26-ae5f-89f406aa5f0f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.328857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-fc546fcb-530c-4cd0-87e3-6e1a873b696f req-3f54f901-6cef-4f26-ae5f-89f406aa5f0f service nova] Creating event network-changed:648c20bd-32e2-430a-a5cb-c0a728e71c74 for instance 388a2bcc-b930-4062-9ab7-e611f34dc102 on hv-cinder-85220 Sep 02 21:26:29.336795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-fc546fcb-530c-4cd0-87e3-6e1a873b696f req-3f54f901-6cef-4f26-ae5f-89f406aa5f0f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041399 Sep 02 21:26:29.337722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 234/489] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:29.372786 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:29.383814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-94b33564-93cb-4636-acda-40be9265950b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.307052 Sep 02 21:26:29.383814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 256/490] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:29 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:29.882251 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:29.882963 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:29.893885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.893885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.893885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.893885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.894326 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.894326 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.904183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:29.905131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:29.912031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.912566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.912972 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:29.913698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:29.914212 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:29.914645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:30.166910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:30.176752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:30.178216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:30.179454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d3a2263c-3120-4b4d-8006-203dacf46072 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.302002 Sep 02 21:26:30.180012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 235/491] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:29 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:30.198473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:30.202656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5b37e118-6a7c-4767-9f2a-d11b553adf1a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.302472 Sep 02 21:26:30.205787 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 257/492] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:29 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:30.209237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:30.209237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:30.211452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:30.213290 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:30.213788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:30.214296 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:30.215029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:30.215482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:30.215953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:30.281395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:30.289536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fcef5515-8740-498c-979f-f6dab9541a10 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1271 microversion: 2.1 time: 0.108347 Sep 02 21:26:30.290143 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 236/493] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:30 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:30.316832 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:30.317443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:30.324243 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:30.324704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:30.325142 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:30.326004 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:30.326320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:30.326742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:30.406026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:30.406878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:30.414516 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:30.414953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:30.415697 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:30.416463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:30.417155 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:30.417549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:30.612915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:30.621271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5d065f51-4261-4549-bd44-99a18cc33d66 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1276 microversion: 2.1 time: 0.308865 Sep 02 21:26:30.622008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 258/494] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:30 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1276 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:30.666772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:30.675860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ff4c0c4b-0e0f-48e8-aa87-dfe5b34db17b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.273829 Sep 02 21:26:30.676533 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 237/495] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:30 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:31.084771 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-8feecd62-0eb2-4abf-aff0-55cd73d6ec08 req-9774b28b-67a4-4047-a5a4-5ef0c72768fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06870d3d-d4b2-4493-b4a9-c6e33f1824be", "name": "network-vif-plugged", "status": "completed", "tag": "737355df-9df5-464b-b327-d997ff9abc7a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:31.094586 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-8feecd62-0eb2-4abf-aff0-55cd73d6ec08 req-9774b28b-67a4-4047-a5a4-5ef0c72768fc service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.095644 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-8feecd62-0eb2-4abf-aff0-55cd73d6ec08 req-9774b28b-67a4-4047-a5a4-5ef0c72768fc service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.096416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-8feecd62-0eb2-4abf-aff0-55cd73d6ec08 req-9774b28b-67a4-4047-a5a4-5ef0c72768fc service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.107685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-8feecd62-0eb2-4abf-aff0-55cd73d6ec08 req-9774b28b-67a4-4047-a5a4-5ef0c72768fc service nova] Creating event network-vif-plugged:737355df-9df5-464b-b327-d997ff9abc7a for instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be on hv-cinder-85220 Sep 02 21:26:31.113250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-8feecd62-0eb2-4abf-aff0-55cd73d6ec08 req-9774b28b-67a4-4047-a5a4-5ef0c72768fc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032521 Sep 02 21:26:31.113873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 259/496] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:31.213797 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:31.213797 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:31.220436 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.220938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.221379 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.222228 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.222696 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.223125 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.231863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:31.232894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:31.242337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.242337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.245754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.245754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.245754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.245754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.297286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:31.319836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=10 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:31.542663 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:31.553331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:31.554848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:31.556029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fe2613b3-89ac-4046-a3c6-7d9f78fc08df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.350951 Sep 02 21:26:31.556583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 238/497] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:31 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:31.561559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:31.562195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:31.562942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:31.569206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.569608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.570268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.570967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.571417 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.572222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.573755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7a74350f-48c5-41c4-b582-22630c48fee5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.344712 Sep 02 21:26:31.574512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 260/498] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:31 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:31.645844 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:31.646527 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:31.653475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.653999 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.654435 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.655153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.655682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.656105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.759704 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:31.768640 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-cf4db9a3-1f03-43c4-acad-66b2aef09ef6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.210827 Sep 02 21:26:31.782450 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 239/499] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:31 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:31.790551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:31.791507 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:31.798839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.799892 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.800948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.802053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:31.802677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:31.803259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:31.864611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:31.878896 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-89a0c098-3110-4ad5-8b2c-dd8982f0b420 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1276 microversion: 2.1 time: 0.237680 Sep 02 21:26:31.882073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 261/500] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:31 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:32.102044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:32.129674 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7c551ad9-331a-44b8-ad0a-b24eacdd92b3 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.345965 Sep 02 21:26:32.131015 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 240/501] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:31 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:32.585037 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:32.585653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:32.592400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:32.592899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:32.593343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:32.594105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:32.595277 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:32.596137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:32.601649 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:32.611301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:32.611301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:32.611301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:32.611301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:32.611933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:32.612134 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:32.612633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:32.993209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:32.996402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:33.013561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-250bf2be-f256-480b-a95f-e480b72a52b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.406073 Sep 02 21:26:33.014157 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:33.014157 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:33.014157 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d0556998-9746-42b8-a0f3-87c53d4ed215 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.429943 Sep 02 21:26:33.014443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 262/502] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:32 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:33.020103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:33.020755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:33.036695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.037261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.037640 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 241/503] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:32 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:33.038287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.039488 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.040083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.040540 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.050789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:33.051635 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:33.059833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.060392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.060841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.061708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.062201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.062715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.510839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=12 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:33.612469 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:33.622780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-db047c4e-4e41-4a4c-89d5-a3d1a3b42c8e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.583706 Sep 02 21:26:33.624076 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 242/504] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:33 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:33.643839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:33.644773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:33.655283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.659523 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:33.661874 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.662689 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.663708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.664931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.665671 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.668855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-484e686b-f057-4eea-a799-804d8e37c2cc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.656239 Sep 02 21:26:33.669513 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 263/505] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:33 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:33.722846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-6d87cd68-41c6-4c38-8493-6466a1449b97 req-36dda420-c3d4-4b63-a352-826117c2cacd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb216c8b-c233-41d3-b655-87f77b8f2311", "tag": "7ae3fcd6-e84f-491d-957b-485d5a0517d3"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:33.737910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-6d87cd68-41c6-4c38-8493-6466a1449b97 req-36dda420-c3d4-4b63-a352-826117c2cacd service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:33.738561 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-6d87cd68-41c6-4c38-8493-6466a1449b97 req-36dda420-c3d4-4b63-a352-826117c2cacd service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:33.739108 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-6d87cd68-41c6-4c38-8493-6466a1449b97 req-36dda420-c3d4-4b63-a352-826117c2cacd service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:33.768310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-6d87cd68-41c6-4c38-8493-6466a1449b97 req-36dda420-c3d4-4b63-a352-826117c2cacd service nova] Creating event network-changed:7ae3fcd6-e84f-491d-957b-485d5a0517d3 for instance eb216c8b-c233-41d3-b655-87f77b8f2311 on hv-cinder-85220 Sep 02 21:26:33.774208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-6d87cd68-41c6-4c38-8493-6466a1449b97 req-36dda420-c3d4-4b63-a352-826117c2cacd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055577 Sep 02 21:26:33.775175 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 264/506] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:26:33.884404 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:33.902355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c16bd9e1-e67d-44e2-911b-3d3f3b015ab8 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1358 microversion: 2.1 time: 0.276807 Sep 02 21:26:33.919392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 243/507] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:33 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1358 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:34.039386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:34.040223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:34.040387 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:34.042255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:34.051376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.052168 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.052767 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.053226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.053740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.054047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.054578 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.054829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.055416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.055797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.056569 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.057180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.067102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:34.318771 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:34.328360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d4edf0ac-cd78-4ebd-b329-747a39628c53 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.295141 Sep 02 21:26:34.329085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 265/508] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:34 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:34.351909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:34.368060 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:34.370140 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:34.371777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-88b4d6b2-bbc7-41cb-953a-1a2dd77948c8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.336133 Sep 02 21:26:34.372521 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 244/509] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:34 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:26:34.655937 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:34.656952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:34.670173 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.671182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.671708 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.672645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.674115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.674603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.697892 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:34.698551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:34.714214 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.714715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.715192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.715918 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.716369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.716975 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.904644 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:34.913428 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f13b273e-0336-4f20-9d9f-7d881c5f2843 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.263546 Sep 02 21:26:34.914104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 266/510] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:34 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:34.916335 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:34.924198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6c80a06c-7aec-4f8f-a3f4-1ce2917f588c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.235157 Sep 02 21:26:34.924761 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 245/511] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:34 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:34.935367 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:34.936087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:34.942340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.942824 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.943333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:34.944033 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:34.944486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:34.944913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.090176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.099963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-91050c0a-6a48-4e89-8846-94b23ee83e38 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1548 microversion: 2.1 time: 0.168452 Sep 02 21:26:35.100585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 267/512] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:34 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:35.124280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:35.124982 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:35.132320 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.132832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.133303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.134097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.134594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.135059 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.283082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.293747 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d16e1494-68e0-43b4-9186-cd1af4bfd0f9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1548 microversion: 2.1 time: 0.173730 Sep 02 21:26:35.294688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 246/513] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:35 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1548 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:35.319204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:35.324403 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.325178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Searching by: {'deleted': False, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268'} {{(pid=121512) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 02 21:26:35.332684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.333219 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.333690 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.334461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.334949 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.335396 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.360884 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:35.361636 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:35.368673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.369278 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.369758 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.370573 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.371094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.371589 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.452295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.multi_cell_list [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121512) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 02 21:26:35.534213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.537602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:35.543007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-26c9a331-1ff0-405c-a9d8-a0759d9809e6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.186554 Sep 02 21:26:35.544122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 247/514] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:35 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:35.553265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:35.554495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:35.562435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.563418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.563913 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.564726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.565179 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.565602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.578565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d892a8c3-6808-496c-986e-832a2964f0be tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.263462 Sep 02 21:26:35.579753 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 268/515] 10.222.0.79 () {58 vars in 1125 bytes} [Fri Sep 2 21:26:35 2022] GET /compute/v2.1/servers => generated 342 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:35.592962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:35.598727 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:35.606512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.607001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.607853 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.608630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.609093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.609836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.851346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.867177 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.869365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.870867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-66714761-774c-41e2-9809-288a1fa3736b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.325592 Sep 02 21:26:35.871930 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 248/516] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:35 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:35.904235 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:35.924052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4579ab94-070f-4a00-8541-7a4b0b895736 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1548 microversion: 2.1 time: 0.335172 Sep 02 21:26:35.925850 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 269/517] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:35 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1548 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:35.936663 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:35.938571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:35.953500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:35.953500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:35.961265 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.961900 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.962180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.962806 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.963258 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.963814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.964054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.964655 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.965229 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:35.965441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:35.966316 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:35.969832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:36.352167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:36.362389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7a382a11-2952-4a29-964f-d277744eedbc tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.414844 Sep 02 21:26:36.363118 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 270/518] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:35 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:36.380393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:36.402105 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-41780621-74b1-4038-814b-3c3eba76bf25 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.464618 Sep 02 21:26:36.410388 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 249/519] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:35 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:36.569785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:36.570616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:36.577639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:36.578918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:36.579744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:36.580734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:36.581275 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:36.581859 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:36.770095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:36.779656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-67a4e4e9-e56d-4716-9654-ac413ead1129 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.214182 Sep 02 21:26:36.780518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 271/520] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:36 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:36.904715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:36.906092 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:36.913461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:36.913984 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:36.914558 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:36.915265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:36.915955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:36.916616 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:37.114293 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:37.123065 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:37.124512 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:37.125748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d94dcb07-49a5-4ba3-88da-56c4b324ff4c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.225234 Sep 02 21:26:37.126327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 250/521] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:36 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:26:37.388699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:37.389581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:37.395986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:37.396510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:37.396950 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:37.397683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:37.398168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:37.413253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:37.423720 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:37.424865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:37.431958 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:37.433088 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:37.433753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:37.435068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:37.435781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:37.436433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:37.624124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:37.636341 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-49098ada-ad5c-43e8-838c-e923803ce6d3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.250957 Sep 02 21:26:37.642879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 272/522] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:37 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:37.666845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:37.666845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-515b0c87-509f-4adc-8cec-a633608eaaf1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.248378 Sep 02 21:26:37.667596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 251/523] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:37 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:37.808124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:37.808704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:37.816019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:37.816523 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:37.816967 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:37.817698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:37.818330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:37.818765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.000230 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:38.021237 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-818deefe-339a-4c56-9cc4-e0ac8c2dd2f1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.217408 Sep 02 21:26:38.024001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 273/524] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:37 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:38.158875 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:38.160571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:38.171635 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.173113 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.173984 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.175276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.176225 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.176940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.362200 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:38.371144 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:38.372587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:38.374045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-77b10a8b-ec02-4eb8-bbe2-c651ece12dc5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.226207 Sep 02 21:26:38.374595 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 252/525] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:38 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:38.660912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:38.661539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:38.667922 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.668400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.668841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.669532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.670035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.670492 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.690523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:38.691131 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:38.697753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.698263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.698720 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.699620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:38.700157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:38.700578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:38.911731 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:38.920326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-586e7b35-ef7e-4b93-adf5-ed405ba40169 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.264021 Sep 02 21:26:38.921304 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 274/526] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:38 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:38.951377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:38.953556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fd4c0dcc-1465-4364-8e85-9dcbf2bc3124 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.267246 Sep 02 21:26:38.955079 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 253/527] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:38 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:39.045045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:39.045698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:39.054118 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:39.054608 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:39.055040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.055775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:39.056273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:39.056706 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.252319 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:39.263913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b7320226-4829-441f-b5a1-bc2d912d37ab tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.222555 Sep 02 21:26:39.266505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 275/528] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:39 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:39.411430 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:39.413050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:39.432404 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:39.432913 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:39.433365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.435660 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:39.436211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:39.436674 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.738565 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:39.756678 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:39.760764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:39.762809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ba4cf896-ddbc-4b3c-b64e-d4e7d46e5731 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.356778 Sep 02 21:26:39.763774 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 254/529] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:39 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:39.956788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:39.958884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:39.967849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:39.970155 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:39.970610 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.971637 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:39.972531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:39.973355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:39.983750 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:39.984568 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:40.013195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:40.013769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:40.014504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:40.015237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:40.015682 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:40.021164 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:40.243153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:40.265718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bcc4d205-2bea-4762-adf9-cafcb694280d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.320068 Sep 02 21:26:40.266971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 276/530] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:39 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:40.280267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:40.296970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:40.298797 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:40.306217 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-abda5d09-4a89-4057-b4c5-201e0d36c929 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.318748 Sep 02 21:26:40.307353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 255/531] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:39 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:40.307795 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:40.308487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:40.309134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:40.310091 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:40.310809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:40.311493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:40.551521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:40.561062 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9ee5ab5d-9dfa-4fa8-a56d-3492b95ba47d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.268718 Sep 02 21:26:40.574867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 277/532] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:40 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:40.679636 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-10876086", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "networks": [{"uuid": "e47a31a6-75bb-4964-889d-3ce9e7152802"}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:40.791542 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] validate_networks() for [('e47a31a6-75bb-4964-889d-3ce9e7152802', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:26:40.808380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:40.810327 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:40.841885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:40.843807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:40.847672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:40.849251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:40.850402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:40.851623 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.124556 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:41.140242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:41.141750 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:41.143087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fd530f11-1f68-4c72-9363-cb7091bd3e25 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.344166 Sep 02 21:26:41.143549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 278/533] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:40 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:41.311782 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:41.313463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:41.324611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.325590 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.326279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.327360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.327983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.328774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.518319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:26:41.519003 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:26:41.519844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:26:41.520330 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:26:41.520769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:26:41.530403 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.530892 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.532561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.533359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.533830 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.534365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.552177 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:41.553941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Getting quotas for project 5f6a7d90bafa459f8a24d89a10132b78. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:26:41.559414 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Getting quotas for user 7431e8c106ba4e2689c0aa1001bbafe7 and project 5f6a7d90bafa459f8a24d89a10132b78. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:26:41.560820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6432b092-ab3b-4a2e-b1f2-f7951f6d1406 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.254980 Sep 02 21:26:41.574448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:26:41.577270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 279/534] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:41 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:41.577445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:26:41.582925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:41.583223 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:41.643003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.643194 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.643599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.644295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.644808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.645228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.838627 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e515f209-4bf7-4d08-bfec-6592c5e556f2 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.162902 Sep 02 21:26:41.839775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 256/535] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:26:41.849093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:41.855026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:41.875901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.876926 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.877833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:41.879245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:41.885797 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:41.886870 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:42.195536 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:42.206110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fe02faa1-8090-4b16-9220-b299885296b8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.626755 Sep 02 21:26:42.208840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 280/536] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:41 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:42.218187 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7504ca38-f42a-450b-8fe8-f8cbf40cc4f6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:42.218393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7504ca38-f42a-450b-8fe8-f8cbf40cc4f6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:42.245968 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:42.259522 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-795a18d1-da98-4c31-a6bd-d6d5b6d8a2fd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.418412 Sep 02 21:26:42.279776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 257/537] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:41 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:42.289161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "28e4eb90-a4d7-47df-85a6-4f7f141979f0"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:42.318902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:42.318902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:42.318902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:42.318902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:42.319250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:42.319485 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:42.349563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7504ca38-f42a-450b-8fe8-f8cbf40cc4f6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:42.354903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:42.360194 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7504ca38-f42a-450b-8fe8-f8cbf40cc4f6 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1217 microversion: 2.1 time: 0.150100 Sep 02 21:26:42.363587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 281/538] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:42 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:42.376939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:42.383586 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:42.397684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:42.409955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:42.409955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:42.409955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:42.409955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:42.410523 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:42.447482 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:42.676521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:42.692271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:42.692271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:42.692271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-dd5e8857-8834-4db8-9aec-df85654e3954 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.326687 Sep 02 21:26:42.695403 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 282/539] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:42 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:42.715676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:42.716299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:42.724374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:42.725076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:42.725769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:42.731821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:42.731821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:42.731821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:42.951679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:42.967804 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-98d1b52e-a258-4d17-897f-21a46190ff3d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.264303 Sep 02 21:26:42.970862 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 283/540] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:42 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:43.257321 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:43.258123 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:43.271544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.272045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.272969 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.273698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.274203 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.274643 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.482956 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:43.493621 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b70fd849-44ce-4eb7-8f12-e9f3ac007b28 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.241922 Sep 02 21:26:43.494271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 284/541] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:43 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:43.506478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:43.507333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:43.515271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.516258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.516705 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.517563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.518170 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.518713 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.811283 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:43.819808 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-91b82e46-6d58-4e65-90ba-9824136fabfd tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.324426 Sep 02 21:26:43.820391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 285/542] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:43 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:43.824897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:43.825598 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:43.832892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.833407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.834001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.834790 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.835241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.835662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.922650 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:43.931841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-44c95cdc-991e-4f87-b110-6f4fce9cf270 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1221 microversion: 2.1 time: 0.110381 Sep 02 21:26:43.932810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 286/543] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:43 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:43.946538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:43.947231 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:43.955499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.956060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.956571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:43.957358 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:43.957917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:43.958631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:44.164802 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:44.175860 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:44.177408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:44.178736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e1a619fc-5971-4f51-99e4-ef375551af3c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.244930 Sep 02 21:26:44.180216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 287/544] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:43 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:44.206567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:44.207113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:44.238320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:44.238320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:44.238320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:44.238320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:44.239116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:44.239116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:44.400102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:44.411754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2fec9240-4f22-477b-828b-9fcf6427c759 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.212694 Sep 02 21:26:44.412678 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 288/545] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:44 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:44.535700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:44.536546 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:44.550366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:44.551285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:44.552146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:44.553010 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:44.553554 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:44.554098 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:44.785837 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:44.797131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a977d563-cf47-4074-9ce9-ac30e5794a34 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.266079 Sep 02 21:26:44.801653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 289/546] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:44 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:44.846141 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:44.846904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:44.855924 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:44.856490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:44.857350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:44.858323 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:44.858877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:44.860170 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:45.082896 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:45.088539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-109c5179-2d1c-4ae3-8248-f4a5ed6ece70 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.248452 Sep 02 21:26:45.090268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 290/547] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:44 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:45.096657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:45.097478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:45.105365 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:45.106146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:45.106803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:45.108761 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:45.109528 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:45.110994 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:45.199617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:45.211987 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0b3c6553-4b0d-40b4-aa00-7de55db6ba26 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1221 microversion: 2.1 time: 0.119348 Sep 02 21:26:45.212962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 291/548] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:45 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1221 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:45.221940 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:45.222980 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:45.231966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:45.232649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:45.233300 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:45.234269 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:45.235357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:45.235986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:45.375391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:45.394138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:45.410340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:45.413212 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:45.415505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f1baa5bf-4bb5-4910-aed8-34e70e5ef692 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.200929 Sep 02 21:26:45.416545 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 292/549] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:45 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:45.443124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:45.444037 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:45.452830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:45.454487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:45.455388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:45.456580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:45.457051 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:45.457597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:45.641371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:45.651121 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-de89eecb-80a4-409f-8bf8-3854acdc90d1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.213422 Sep 02 21:26:45.652041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 293/550] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:45 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:45.825046 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:45.825683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:45.833525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:45.834168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:45.834605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:45.835318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:45.835782 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:45.836258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:46.009027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:46.020617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9af4957d-afde-4476-8330-efaed5bdc9f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.199141 Sep 02 21:26:46.021342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 294/551] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:45 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:46.123607 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:46.124452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:46.132199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:46.132692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:46.133181 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:46.133890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:46.134346 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:46.134782 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:46.325279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:46.334471 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ab5e4ed9-da37-4dad-b392-269da159b71e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1372 microversion: 2.1 time: 0.215184 Sep 02 21:26:46.335715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 295/552] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:46 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:46.357181 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:46.358047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:46.386034 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:46.386910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:46.392463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:46.394168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:46.401603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:46.406507 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:46.532010 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:46.548445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5514d18c-0f51-44f3-a25b-212bcbe4b2c4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1221 microversion: 2.1 time: 0.209096 Sep 02 21:26:46.548445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 296/553] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:46 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1221 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:46.555677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:46.556424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:46.594203 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:46.594947 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:46.596351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:46.597896 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:46.598106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:46.598894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:46.795834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:46.806232 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:46.807713 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:46.809127 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6570b751-708e-44d7-bb0f-39a8885d530a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.259522 Sep 02 21:26:46.809692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 297/554] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:46 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:46.814657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:46.815270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:46.822841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:46.823341 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:46.823862 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:46.824861 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:46.825329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:46.825755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.041506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:47.059962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-25950900-731d-457d-9221-633e8bc1f747 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.249104 Sep 02 21:26:47.060877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 298/555] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:46 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:47.067107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:47.067951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:47.079113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.079915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.084978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.084978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.084978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.084978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.090041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:47.288915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:47.300105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f0052f72-807d-4ad3-884f-170c0fa9bb73 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.238162 Sep 02 21:26:47.300830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 299/556] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:47 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:47.364287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:47.365045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:47.371617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.372180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.372677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.373462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.373990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.374447 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.525032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:47.537135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fdf464f7-c92e-4012-983c-74e69cbfe8d1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1566 microversion: 2.1 time: 0.177493 Sep 02 21:26:47.549759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 300/557] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:47 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:47.563285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:47.563769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:47.573561 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.575100 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.575340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.576646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.576920 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.577349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.731565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f4493f10-3d35-40e3-ae6a-1bd9eec85398 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172388 Sep 02 21:26:47.735622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 301/558] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Sep 2 21:26:47 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-interface => generated 284 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:26:47.740163 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:47.741137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:47.745440 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:47.751582 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.755454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.755942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.758219 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.759183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.759914 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.888218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:47.897057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2b7c1a54-7d4e-4dfc-a7a4-8abf893076ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1213 microversion: 2.1 time: 0.162987 Sep 02 21:26:47.897647 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 302/559] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:47 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1213 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:47.902384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:47.903133 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:47.912975 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.913731 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.914299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:47.915084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:47.915613 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:47.916119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:48.171805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:48.190775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:48.192551 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:48.193748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1707ed9b-5a40-44d2-abbe-f73e6db7cd62 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.295090 Sep 02 21:26:48.205522 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 303/560] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:47 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:48.230089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:48.241556 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:48.244040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:48.244913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:48.246268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:48.249082 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:48.249082 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:48.249082 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:48.735202 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1782bd0c-b8c4-43b2-9c2f-ab1ddf9b0d79 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "POST /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.471060 Sep 02 21:26:48.742206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 258/561] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:26:42 2022] POST /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments => generated 194 bytes in 6479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:48.757574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:48.757574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:48.757574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:48.757574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:48.758663 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:48.759887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:48.760532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:48.761138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:48.810202 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:48.821415 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-593e0636-0157-4749-88f9-ff6dc7722e9a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.600043 Sep 02 21:26:48.822189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 304/562] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:48 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:48.924511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:48.925132 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:48.931884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:48.932742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:48.933285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:48.934135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:48.935099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:48.935099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:48.957471 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:48.965998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1b8c4b61-6ecf-439b-88fb-31051fe815bb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.222119 Sep 02 21:26:48.966580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 259/563] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:48 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:49.003207 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:49.011450 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d2cb3938-7145-41f7-8506-97e43f8ce995 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1213 microversion: 2.1 time: 0.091623 Sep 02 21:26:49.012038 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 305/564] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:48 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:49.225159 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:49.225775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:49.232537 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:49.233030 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:49.233466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:49.235061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:49.235920 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:49.236688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:49.512058 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:49.522821 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:49.524553 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:49.528463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8f6f0f2e-3220-4b82-9996-1a6d54adfe26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.307761 Sep 02 21:26:49.529185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 260/565] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:49 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:49.808173 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-9c8dc8de-9675-4c1f-8019-69a00c372d06 req-bc7fe958-28b6-4321-8697-4b6af2b195d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06870d3d-d4b2-4493-b4a9-c6e33f1824be", "tag": "737355df-9df5-464b-b327-d997ff9abc7a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:49.831087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-9c8dc8de-9675-4c1f-8019-69a00c372d06 req-bc7fe958-28b6-4321-8697-4b6af2b195d4 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:49.837679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-9c8dc8de-9675-4c1f-8019-69a00c372d06 req-bc7fe958-28b6-4321-8697-4b6af2b195d4 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:49.838408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-9c8dc8de-9675-4c1f-8019-69a00c372d06 req-bc7fe958-28b6-4321-8697-4b6af2b195d4 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:49.853364 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:49.863355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:49.875409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:49.875953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:49.876445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:49.879808 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:49.880552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:49.881188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:49.889675 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-9c8dc8de-9675-4c1f-8019-69a00c372d06 req-bc7fe958-28b6-4321-8697-4b6af2b195d4 service nova] Creating event network-changed:737355df-9df5-464b-b327-d997ff9abc7a for instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be on hv-cinder-85220 Sep 02 21:26:49.919806 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-9c8dc8de-9675-4c1f-8019-69a00c372d06 req-bc7fe958-28b6-4321-8697-4b6af2b195d4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117999 Sep 02 21:26:49.920619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 306/566] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:49.994655 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:49.995555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:50.014621 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:50.016018 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:50.016649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:50.017653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:50.018302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:50.018883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:50.415119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:50.425265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d3b457a7-e6d5-47f9-9150-78fa079ecdb1 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.576483 Sep 02 21:26:50.426122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 261/567] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:49 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:50.430715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:50.431431 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:50.439190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:50.439685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:50.440125 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:50.440844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:50.441986 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:50.442442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:50.454403 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:50.472322 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e3127129-0f51-48ae-b573-00c126af4e88 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.483850 Sep 02 21:26:50.473172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 307/568] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:49 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:50.524091 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:50.532166 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2245bbd8-f294-4999-b24b-05f800bdb31c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1213 microversion: 2.1 time: 0.105212 Sep 02 21:26:50.532724 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 262/569] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:50 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:50.557761 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:50.558439 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:50.565671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:50.566369 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:50.566802 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:50.567634 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:50.568098 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:50.568519 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:50.822624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:50.831737 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:50.833171 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:50.834557 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a4234cd3-a574-4542-9684-c02ca302e0e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.281814 Sep 02 21:26:50.835107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 308/570] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:50 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:51.457183 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:51.459429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:51.472577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:51.481286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:51.481286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:51.481286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:51.481286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:51.485151 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:51.498500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:51.499129 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:51.513725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:51.517622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:51.518120 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:51.520878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:51.522258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:51.523246 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:51.541685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:51.570674 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:51.745250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:51.752971 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:51.759986 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-058d3a45-ac6c-46b6-b924-6688088a8eee tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.309754 Sep 02 21:26:51.761226 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 263/571] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:51 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:51.768856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:51.770265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:51.777698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:51.782158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:51.783460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:51.784579 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:51.786641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:51.787316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ec50156a-3a0a-410e-af62-4af9fe1c5edc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.293825 Sep 02 21:26:51.788847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:51.789357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 309/572] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:51 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:51.790836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:51.863846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:51.864787 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:51.871841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:51.872340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:51.872789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:51.873555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:51.874072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:51.875738 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:51.885967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:51.897544 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-74e95cdf-bc44-4834-994b-8b3cf4129fe3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1269 microversion: 2.1 time: 0.134691 Sep 02 21:26:51.898239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 264/573] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:51 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1269 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:52.114285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:52.125587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:52.126474 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:52.127395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-436ad7ac-ec4d-408c-9d50-3323d4ee3c26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.267721 Sep 02 21:26:52.128023 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 310/574] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:51 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:52.805664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:52.806301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:52.817633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:52.830759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:52.831015 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:52.831200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:52.831365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:52.831365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:52.831365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:52.831365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:52.831951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:52.831951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:52.831951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:52.831951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:52.832538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:52.832538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:52.832538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:53.163630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:53.185129 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ac540457-a1ca-4481-8fc6-f482bbf23d08 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.382766 Sep 02 21:26:53.188062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 265/575] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:52 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:53.195549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:53.197048 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:53.198676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:53.208190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:53.209377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:53.210158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:53.211791 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:53.212688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:53.213556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:53.226101 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-851adccf-ab01-47a5-a7f4-8fdc6c8a429e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.414730 Sep 02 21:26:53.231732 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 311/576] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:52 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:53.244350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:53.245539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:53.265836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:53.265836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:53.265836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:53.265836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:53.266409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:53.266409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:53.387603 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:53.397537 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c6429693-4499-47e0-b18d-33fb3f2a5ec3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1269 microversion: 2.1 time: 0.206511 Sep 02 21:26:53.398447 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 266/577] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:53 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:53.653490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-91347e25-7567-4c18-b3f1-487c5e932b13 req-2c0652a5-3382-461a-869d-c3e4cc29b9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "388a2bcc-b930-4062-9ab7-e611f34dc102", "name": "network-vif-plugged", "status": "completed", "tag": "648c20bd-32e2-430a-a5cb-c0a728e71c74"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:53.670858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-91347e25-7567-4c18-b3f1-487c5e932b13 req-2c0652a5-3382-461a-869d-c3e4cc29b9f7 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:53.671596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-91347e25-7567-4c18-b3f1-487c5e932b13 req-2c0652a5-3382-461a-869d-c3e4cc29b9f7 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:53.672381 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-91347e25-7567-4c18-b3f1-487c5e932b13 req-2c0652a5-3382-461a-869d-c3e4cc29b9f7 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:53.687496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-91347e25-7567-4c18-b3f1-487c5e932b13 req-2c0652a5-3382-461a-869d-c3e4cc29b9f7 service nova] Creating event network-vif-plugged:648c20bd-32e2-430a-a5cb-c0a728e71c74 for instance 388a2bcc-b930-4062-9ab7-e611f34dc102 on hv-cinder-85220 Sep 02 21:26:53.697482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-91347e25-7567-4c18-b3f1-487c5e932b13 req-2c0652a5-3382-461a-869d-c3e4cc29b9f7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048769 Sep 02 21:26:53.701392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 267/578] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:26:53.767444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:53.777122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:53.778846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:53.779915 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-efe6ca47-8483-4b35-b70d-382b5925ccfe tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.547037 Sep 02 21:26:53.782133 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 312/579] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:53 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:54.226906 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:54.226906 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:54.235367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.235848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.236283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.237128 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.237572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.238017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.257707 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:54.259639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:54.271376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.272405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.273325 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.274723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.275682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.276574 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.559207 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:54.568817 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d19d626f-31ad-4767-af56-a19c7ce209f5 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.351032 Sep 02 21:26:54.569524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 268/580] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:54 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:54.573333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:54.574858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:54.575502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:54.585903 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9965d8bd-2fc2-431b-894c-928a0a3966e5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.332624 Sep 02 21:26:54.589766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 313/581] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:54 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:54.593943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.594789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.595548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.596421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.597029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.597645 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.665312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:54.677260 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-bb011288-491c-4b22-bf75-dba8df764bb1 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1277 microversion: 2.1 time: 0.106524 Sep 02 21:26:54.677855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 269/582] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:54 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1277 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:54.809530 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:54.810283 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:54.817442 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.817965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.818433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.819236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:54.819708 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:54.820125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:54.983342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:54.993292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:55.000141 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:55.000141 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5631bf45-5148-48c7-9097-b6e064239f75 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.191257 Sep 02 21:26:55.000141 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 314/583] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:54 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:55.603275 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:55.606693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:55.614962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:55.615539 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:55.616225 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:55.617220 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:55.617882 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:55.618771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:55.618893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:55.620003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:55.638894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:55.640645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:55.641792 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:55.644152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:55.645668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:55.646787 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:55.882715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:55.904139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a8fc9d2f-00e0-47c7-bea5-67fb49eaa53f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.307688 Sep 02 21:26:55.904739 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 270/584] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:55 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:55.911108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:55.912800 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:55.913316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:55.921029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:55.922267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:55.922726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:55.923581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:55.924100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:55.924664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:55.952537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1fc1c8e0-c78a-47ed-98dc-d7cd29e1c3c5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.338916 Sep 02 21:26:55.966289 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 315/585] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:55 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:56.013342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:56.025762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:56.026408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:56.027275 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-414f9393-e628-49e5-b1b6-c107ab6cecec tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1287 microversion: 2.1 time: 0.120663 Sep 02 21:26:56.028581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 271/586] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:55 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:56.038629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.040570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.040570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.040570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.040869 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.041328 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.239629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:56.243928 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:26:56.259097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:56.261676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:56.264300 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4c79671f-e8b8-4686-a439-d09e2022f8e7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.243607 Sep 02 21:26:56.266602 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 316/587] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:56 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:56.932295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:56.932901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:56.942707 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.948384 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.948384 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.948384 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.948384 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.948999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.985379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:56.986648 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:56.994534 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.995298 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.995913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:56.996629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:56.997087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:56.997518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.213664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:57.228347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0e2d229d-b8bf-4b67-a296-a16127d11a0b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.299885 Sep 02 21:26:57.229355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 272/588] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:56 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:57.244353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:57.245294 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:57.253776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:57.254841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:57.255698 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.256695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:57.257495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:57.258184 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.274684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:57.284307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fb9de97c-356b-4600-bfaa-9a0fd532606d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1264 microversion: 2.1 time: 0.306681 Sep 02 21:26:57.285273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 317/589] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:56 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1264 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:26:57.303350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:57.304000 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:57.310657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:57.311143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:57.311783 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.312910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:57.313540 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:57.314166 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:57.543717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:57.560884 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e8338ab7-fbd6-4b3e-a90b-5a16b34dd58d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.321537 Sep 02 21:26:57.563170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 273/590] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:57 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:57.631561 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:57.649374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:57.652225 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:57.653406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-019126a9-761e-48db-9d91-fcc415a86b2e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.353997 Sep 02 21:26:57.653997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 318/591] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:57 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:57.988914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-e0b4b6c5-52b3-4437-b95b-ea8aef2bce92 req-90cf4792-25ea-42c5-a8a5-af4859e625f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb216c8b-c233-41d3-b655-87f77b8f2311", "name": "network-vif-plugged", "status": "completed", "tag": "7ae3fcd6-e84f-491d-957b-485d5a0517d3"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:58.004955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e0b4b6c5-52b3-4437-b95b-ea8aef2bce92 req-90cf4792-25ea-42c5-a8a5-af4859e625f8 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.005713 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e0b4b6c5-52b3-4437-b95b-ea8aef2bce92 req-90cf4792-25ea-42c5-a8a5-af4859e625f8 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.006462 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e0b4b6c5-52b3-4437-b95b-ea8aef2bce92 req-90cf4792-25ea-42c5-a8a5-af4859e625f8 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.024101 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-e0b4b6c5-52b3-4437-b95b-ea8aef2bce92 req-90cf4792-25ea-42c5-a8a5-af4859e625f8 service nova] Creating event network-vif-plugged:7ae3fcd6-e84f-491d-957b-485d5a0517d3 for instance eb216c8b-c233-41d3-b655-87f77b8f2311 on hv-cinder-85220 Sep 02 21:26:58.028428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-e0b4b6c5-52b3-4437-b95b-ea8aef2bce92 req-90cf4792-25ea-42c5-a8a5-af4859e625f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043096 Sep 02 21:26:58.029036 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 274/592] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:58.267357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:58.269463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:58.286629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.287659 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.287886 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.288837 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.289345 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.289798 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.315309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:58.316899 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:58.329244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.330177 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.330867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.335441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.335441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.335441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.518555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:58.555386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-defe71d5-9f0b-48cd-be6e-2e0234190547 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.296283 Sep 02 21:26:58.556456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 319/593] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:58 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:58.575974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-90ccb280-1d4a-4a10-9e40-f2cd5f70930d req-cd4ebc2d-165f-4c01-bfe4-d1e5e7e35f05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78626e37-d502-477b-a62d-858b17bd287d", "tag": "24f515c7-7e7f-4943-950f-12e8c25dc5ca"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:26:58.594043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-90ccb280-1d4a-4a10-9e40-f2cd5f70930d req-cd4ebc2d-165f-4c01-bfe4-d1e5e7e35f05 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.595162 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-90ccb280-1d4a-4a10-9e40-f2cd5f70930d req-cd4ebc2d-165f-4c01-bfe4-d1e5e7e35f05 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.596138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-90ccb280-1d4a-4a10-9e40-f2cd5f70930d req-cd4ebc2d-165f-4c01-bfe4-d1e5e7e35f05 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.605265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:58.619605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-90ccb280-1d4a-4a10-9e40-f2cd5f70930d req-cd4ebc2d-165f-4c01-bfe4-d1e5e7e35f05 service nova] Creating event network-changed:24f515c7-7e7f-4943-950f-12e8c25dc5ca for instance 78626e37-d502-477b-a62d-858b17bd287d on hv-cinder-85220 Sep 02 21:26:58.623566 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7c6e629c-a01e-4e5e-8cd4-43ec8f1f3b35 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1452 microversion: 2.1 time: 0.317583 Sep 02 21:26:58.627370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 275/594] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:58 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1452 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:58.627646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-90ccb280-1d4a-4a10-9e40-f2cd5f70930d req-cd4ebc2d-165f-4c01-bfe4-d1e5e7e35f05 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069097 Sep 02 21:26:58.629035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 320/595] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:26:58.636086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:58.638799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:58.649186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.650510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.650883 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.651714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.652184 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.652655 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.652835 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:58.653499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:58.662446 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.662942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.663533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.664232 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.664785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.665207 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.895081 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:58.915211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:58.922303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e0c107b4-b2b5-4a87-87fc-6244a4cf8c8c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.282964 Sep 02 21:26:58.923433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 276/596] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:58 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:58.929139 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7c5bfa5c-af56-44d4-8e6b-756c9907696a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1452 microversion: 2.1 time: 0.280769 Sep 02 21:26:58.930801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 321/597] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:58 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1452 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:58.943014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:58.944688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:58.966113 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.967135 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.969746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:58.971287 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:58.972245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:58.973129 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:59.201312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:59.214325 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:59.217292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:59.220563 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a5fbb8b0-2c16-49e5-87a0-b43abdf79c6c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.295388 Sep 02 21:26:59.221494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 277/598] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:26:58 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:26:59.588675 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:59.590180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:59.606804 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:59.609457 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:59.611735 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:59.611963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:59.612993 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:59.613131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:59.886842 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:26:59.897669 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c5347979-3906-4383-8a3c-726ec00c4ffb tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.316898 Sep 02 21:26:59.902213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 322/599] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:59 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:26:59.970165 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:26:59.971085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:26:59.986057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:59.987572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:59.988804 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:26:59.990814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:26:59.991685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:26:59.992416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.251744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:00.252811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:00.275054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.275882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.276538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.282933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.283758 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.284507 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.417853 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:00.430682 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8dcc42ce-46dd-44bf-a7b4-15eee98aa0e9 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.476051 Sep 02 21:27:00.431554 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 278/600] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:26:59 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:00.544781 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:00.551970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:00.553570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:00.555032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-030395eb-b624-436a-96c6-4cdef03c50ac tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.311353 Sep 02 21:27:00.555628 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 323/601] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:00 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:27:00.646041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:00.646721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:00.651699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:00.658447 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.659075 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.659668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.660682 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.661515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.662251 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.840745 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lazy-loading 'services' on Instance uuid c0c79e24-443d-42bb-baa0-e9da52325154 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:00.931679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:00.932434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:00.943465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.951359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.952517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:00.953371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:00.953858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:00.954479 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.225954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-53a24475-f016-4681-8e78-7c44c82a1bcc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/os-volume_attachments/038938cf-f9cb-4de8-bdf8-f0807c04a1de" status: 202 len: 0 microversion: 2.1 time: 0.581220 Sep 02 21:27:01.228268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 279/602] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:27:00 2022] DELETE /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/os-volume_attachments/038938cf-f9cb-4de8-bdf8-f0807c04a1de => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:27:01.238315 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:01.239512 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:01.257111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.257111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.257111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.257111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.257612 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.257612 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.296368 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:01.311973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9e6a19ab-013b-4833-8085-f59d47e08269 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.383171 Sep 02 21:27:01.314604 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 324/603] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:00 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:01.458710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:01.459573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:01.472649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.474214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.475295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.476846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.477718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.478347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.570024 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:01.582055 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1079f286-80ba-48ad-a34e-d34323eca8ef tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1594 microversion: 2.1 time: 0.351486 Sep 02 21:27:01.585984 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 280/604] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:01 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1594 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:01.591262 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:01.591980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:01.602256 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.602656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.603454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.604495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:01.604952 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:01.609229 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:01.615714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:01.860973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:01.871554 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-875694c8-bf03-4e5c-a87e-1eb39bcc11e4 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.417573 Sep 02 21:27:01.873245 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 325/605] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:01 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:01.930258 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:01.945954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:01.948843 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:01.950997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f4f54885-ff19-462a-8ad0-625e2b39650a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.366115 Sep 02 21:27:01.952513 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 281/606] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:01 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:27:02.353736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:02.368530 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:02.405995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.407445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.408575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:02.410262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.411989 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.413102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:02.549560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-2207f579-0f3e-418c-8752-ded5b36dc3ff req-a9b431aa-18ed-4302-8e94-bac49b3e0fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5852d6-c6ee-489d-a2cd-a1ce7008540f", "name": "network-vif-plugged", "status": "completed", "tag": "9c460ac1-1f81-408f-907d-b19a443be414"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:02.569119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-2207f579-0f3e-418c-8752-ded5b36dc3ff req-a9b431aa-18ed-4302-8e94-bac49b3e0fff service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.570127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-2207f579-0f3e-418c-8752-ded5b36dc3ff req-a9b431aa-18ed-4302-8e94-bac49b3e0fff service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.571917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-2207f579-0f3e-418c-8752-ded5b36dc3ff req-a9b431aa-18ed-4302-8e94-bac49b3e0fff service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:02.594677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-2207f579-0f3e-418c-8752-ded5b36dc3ff req-a9b431aa-18ed-4302-8e94-bac49b3e0fff service nova] Creating event network-vif-plugged:9c460ac1-1f81-408f-907d-b19a443be414 for instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f on hv-cinder-85220 Sep 02 21:27:02.606161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-2207f579-0f3e-418c-8752-ded5b36dc3ff req-a9b431aa-18ed-4302-8e94-bac49b3e0fff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068116 Sep 02 21:27:02.607247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 282/607] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:02.906300 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:02.907624 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:02.926998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.930046 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.930046 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:02.930046 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:02.930545 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:02.930989 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:03.522558 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:03.540756 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6395053a-0da1-40b2-96c2-1a91b1b7c94c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 1.199649 Sep 02 21:27:03.542501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 326/608] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:02 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:03.559584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:03.560423 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:03.568737 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:03.569146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:03.569611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:03.570370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:03.570829 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:03.571593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:03.684463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:03.701379 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e0f6c879-dd78-4b43-a9da-5a2f6f1b549d tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.801081 Sep 02 21:27:03.702274 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 283/609] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:02 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:04.021125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:04.032360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:04.035751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:04.037392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1ece7b11-5f5c-4916-9770-5b96c0a83389 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.493112 Sep 02 21:27:04.039199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 327/610] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:03 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:27:04.365329 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-35c53b7e-1a2d-49fa-9a01-39f6776630f0 req-4e1d3f0d-fab5-40bc-8130-84d8699f7f87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "388a2bcc-b930-4062-9ab7-e611f34dc102", "tag": "648c20bd-32e2-430a-a5cb-c0a728e71c74"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:04.421032 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-35c53b7e-1a2d-49fa-9a01-39f6776630f0 req-4e1d3f0d-fab5-40bc-8130-84d8699f7f87 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.422007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-35c53b7e-1a2d-49fa-9a01-39f6776630f0 req-4e1d3f0d-fab5-40bc-8130-84d8699f7f87 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.422938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-35c53b7e-1a2d-49fa-9a01-39f6776630f0 req-4e1d3f0d-fab5-40bc-8130-84d8699f7f87 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:04.522583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-35c53b7e-1a2d-49fa-9a01-39f6776630f0 req-4e1d3f0d-fab5-40bc-8130-84d8699f7f87 service nova] Creating event network-changed:648c20bd-32e2-430a-a5cb-c0a728e71c74 for instance 388a2bcc-b930-4062-9ab7-e611f34dc102 on hv-cinder-85220 Sep 02 21:27:04.549662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-35c53b7e-1a2d-49fa-9a01-39f6776630f0 req-4e1d3f0d-fab5-40bc-8130-84d8699f7f87 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189103 Sep 02 21:27:04.556927 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 284/611] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:04.590900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:04.595068 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:04.629176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.640087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.640997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:04.646807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.648048 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.648860 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:04.737794 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:04.742137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:04.760030 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.760825 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.761591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:04.763081 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:04.765692 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:04.766969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:04.962831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:04.997086 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-51c8b8d8-4031-4afd-984e-bfdc227cad0a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1313 microversion: 2.1 time: 0.426987 Sep 02 21:27:04.999908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 328/612] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:04 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1313 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:05.068257 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:05.079864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c2ab8e09-f92d-48c6-92d2-a79a4f56cfb5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.350840 Sep 02 21:27:05.080830 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 285/613] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:04 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:05.084439 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:05.089569 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:05.104355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:05.104916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:05.105397 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:05.106156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:05.106624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:05.115973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:05.394862 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:05.419213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:05.423639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:05.426309 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-50613e15-6107-49ca-8db6-be4b8f48c208 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.345614 Sep 02 21:27:05.427855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 329/614] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:05 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:27:05.942603 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-1141e177-a9e3-475a-9d93-b34d70b68f9e req-65d83745-ab43-40f8-ae31-a810c52656d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "febb8d4c-5149-4e92-9363-4e502f0c1a6d", "tag": "a26f03e8-5797-4109-a4cb-c033343e086e"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:05.976542 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1141e177-a9e3-475a-9d93-b34d70b68f9e req-65d83745-ab43-40f8-ae31-a810c52656d3 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:05.981168 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1141e177-a9e3-475a-9d93-b34d70b68f9e req-65d83745-ab43-40f8-ae31-a810c52656d3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:05.982301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1141e177-a9e3-475a-9d93-b34d70b68f9e req-65d83745-ab43-40f8-ae31-a810c52656d3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.036517 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-1141e177-a9e3-475a-9d93-b34d70b68f9e req-65d83745-ab43-40f8-ae31-a810c52656d3 service nova] Creating event network-changed:a26f03e8-5797-4109-a4cb-c033343e086e for instance febb8d4c-5149-4e92-9363-4e502f0c1a6d on hv-cinder-85220 Sep 02 21:27:06.044811 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-1141e177-a9e3-475a-9d93-b34d70b68f9e req-65d83745-ab43-40f8-ae31-a810c52656d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116124 Sep 02 21:27:06.052475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:06.055367 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:06.056816 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 286/615] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:06.075449 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.076281 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.076917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.082073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.082854 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.083596 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.125742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:06.126941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:06.150492 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.151192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.151665 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.154103 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.155177 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.155632 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.652014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:06.656411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:06.665602 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-85a892fb-a380-4638-a019-8cbfe168a9dd tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1497 microversion: 2.1 time: 0.633909 Sep 02 21:27:06.666218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 330/616] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:06 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1497 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:06.676299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:06.679120 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:06.698809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.699918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.700711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.702047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:06.702900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:06.703990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:06.717853 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-51b824f9-1908-41e1-8f02-7cb6e72652bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.598709 Sep 02 21:27:06.723657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 287/617] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:06 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:07.052360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:07.076944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:07.083533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:07.085122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-aba74691-8c1f-4933-b70f-1507dda887fd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.412927 Sep 02 21:27:07.090460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 331/618] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:06 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:27:07.155343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-76bf6264-b135-44b8-94bd-862955b71176 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:07.170871 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-76bf6264-b135-44b8-94bd-862955b71176 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.171786 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-76bf6264-b135-44b8-94bd-862955b71176 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.172564 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-76bf6264-b135-44b8-94bd-862955b71176 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.268817 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-76bf6264-b135-44b8-94bd-862955b71176 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Going to try to stop instance {{(pid=121513) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 02 21:27:07.547638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-76bf6264-b135-44b8-94bd-862955b71176 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/action" status: 202 len: 0 microversion: 2.1 time: 0.402631 Sep 02 21:27:07.555500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 288/619] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:27:07 2022] POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:27:07.560630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:07.561393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:07.568298 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.568803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.569295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.570238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.570862 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.571490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.758510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:07.764454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:07.783502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.784172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.784664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.785471 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:07.791030 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:07.792311 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:07.840599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:07.882011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e5a96b09-30fd-47d7-acbf-4d2b9d5eec14 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1721 microversion: 2.1 time: 0.328728 Sep 02 21:27:07.884255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 332/620] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:07 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1721 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:08.018251 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:08.027941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2f954881-6bf7-4b4e-8d90-5d8432f765ba tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.275991 Sep 02 21:27:08.029675 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 289/621] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:07 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:08.115073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:08.115918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:08.122146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.122628 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.123688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.124406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.124863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.125285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.299163 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:08.312279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:08.313833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:08.315053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d0b990b2-8808-406c-87bb-1a204010e20d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.204124 Sep 02 21:27:08.315662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 333/622] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:08 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:27:08.536115 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-b7c7308e-54e6-4cb0-88ff-2712136d83bd req-abb3f80c-0298-4c87-ae79-9824a46a7b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78626e37-d502-477b-a62d-858b17bd287d", "name": "network-vif-plugged", "status": "completed", "tag": "24f515c7-7e7f-4943-950f-12e8c25dc5ca"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:08.555840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b7c7308e-54e6-4cb0-88ff-2712136d83bd req-abb3f80c-0298-4c87-ae79-9824a46a7b80 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.556833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b7c7308e-54e6-4cb0-88ff-2712136d83bd req-abb3f80c-0298-4c87-ae79-9824a46a7b80 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.557538 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b7c7308e-54e6-4cb0-88ff-2712136d83bd req-abb3f80c-0298-4c87-ae79-9824a46a7b80 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.573062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-b7c7308e-54e6-4cb0-88ff-2712136d83bd req-abb3f80c-0298-4c87-ae79-9824a46a7b80 service nova] Creating event network-vif-plugged:24f515c7-7e7f-4943-950f-12e8c25dc5ca for instance 78626e37-d502-477b-a62d-858b17bd287d on hv-cinder-85220 Sep 02 21:27:08.581030 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-b7c7308e-54e6-4cb0-88ff-2712136d83bd req-abb3f80c-0298-4c87-ae79-9824a46a7b80 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058762 Sep 02 21:27:08.582231 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 290/623] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:08.616509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:08.617355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:08.628633 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.630191 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.631927 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.633217 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.634124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.640300 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.644225 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:08.681323 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:27:08.923041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:08.924288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:08.934847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.940452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.940452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:08.940452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:08.940452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:08.941097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.169613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.182090 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ee7e929f-27ed-43f1-8ff0-490f33d9f0ad tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.266316 Sep 02 21:27:09.183378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 291/624] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:08 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:09.193086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:09.194208 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:09.202710 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.203204 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.231694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.231694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.231694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.231694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.366545 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.375463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-34f1d210-6610-45d1-a612-a0ee3784d7a3 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.190892 Sep 02 21:27:09.380397 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 292/625] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:09 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:09.381392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:09.382111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:09.391983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.392872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.393612 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.394526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.394948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.395367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.464187 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d710c5fa-648c-4057-8da3-25d4b68bd02e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "DELETE /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 204 len: 0 microversion: 2.1 time: 0.849280 Sep 02 21:27:09.466089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 334/626] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:27:08 2022] DELETE /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 0 bytes in 856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:27:09.480257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:09.481045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:09.488236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.488651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.489090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.490159 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:09.490872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:09.491587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:09.663577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.675206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.677044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.678266 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2c3f55dc-56af-43db-bddc-7503316f5e7d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.301202 Sep 02 21:27:09.678820 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 293/627] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:09 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:27:09.746940 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:09.757913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-591bc7b6-9de7-434d-8b93-882bf246f48c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1503 microversion: 2.1 time: 0.281977 Sep 02 21:27:09.758755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 335/628] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:09 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:10.208942 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:10.209608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:10.217502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.218091 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.218765 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.219581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.220214 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.220748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.404595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:10.405170 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:10.415897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.417624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.418309 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.420039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.420843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.421642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.462296 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:10.477547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7da45a78-d40b-490d-958f-7b20b4b1dd0d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.272274 Sep 02 21:27:10.478893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 294/629] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:10 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:10.677472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:10.687628 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7d9ed5eb-29d0-4349-8916-64e72ba3791b tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.287766 Sep 02 21:27:10.688376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 336/630] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:10 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:10.711387 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:10.712509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:10.729992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.730575 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.731017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.731740 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.733337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.734338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.788074 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:10.788630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:10.798053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.804897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.804897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:10.804897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:10.804897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:10.805535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.037789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:11.054822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:11.057997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:11.065491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5de3b5f7-e192-47cc-a649-ad1ca9499b14 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.361991 Sep 02 21:27:11.084734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 295/631] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:10 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:27:11.088671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:11.099402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-547885a4-b45d-4bed-84e6-e52ab157b529 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1503 microversion: 2.1 time: 0.315820 Sep 02 21:27:11.100287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 337/632] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:10 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:11.500557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-492274231"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:11.501199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:11.508405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.509434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.510282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.511367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.512344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.512860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.517725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:11.518371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:11.524825 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.525343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.525769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.526518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.526978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.527402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.756865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.network.security_group_api [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Adding security group 5e47651a-fedb-40bd-b7f5-570ca3b8125d to port a26f03e8-5797-4109-a4cb-c033343e086e Sep 02 21:27:11.781511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:11.790417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-64aed0b4-a7a9-4ac0-b261-af5fd96bf97d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.276693 Sep 02 21:27:11.791072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 338/633] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:11 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:11.808179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:11.808743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:11.816433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.817168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.817630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:11.818449 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:11.819016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:11.819418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.034530 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.043006 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-07fd806b-1238-4f90-8100-a5c1018d2fc5 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.239414 Sep 02 21:27:12.045636 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 339/634] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:11 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:12.116987 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:12.117676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:12.125366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.125895 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.126346 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.127809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.128461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.128881 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.302879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.312304 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.314447 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.314983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-eb84fc0c-d900-49de-bf43-52ab8a88a42b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1808 microversion: 2.20 time: 0.202156 Sep 02 21:27:12.317368 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 340/635] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:12 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:27:12.320319 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:12.320922 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:12.331430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.331925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.332364 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.333515 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.334015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.334461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.354210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4ca58b06-c538-4046-8868-49e01b785da1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "POST /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/action" status: 202 len: 0 microversion: 2.1 time: 0.859012 Sep 02 21:27:12.355023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 296/636] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:27:11 2022] POST /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:27:12.365871 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:12.366712 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:12.381763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.383262 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.383906 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.384842 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.385557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.386369 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.650822 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.661259 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c5ba3e98-2c13-4f3b-afc7-b51a8e4b2191 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1503 microversion: 2.1 time: 0.344276 Sep 02 21:27:12.663231 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 341/637] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:12 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1503 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:12.668980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:12.669218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-c6006388-f880-41ea-b7ac-6f99c4d8b9cb req-023a0529-5df1-408f-829d-d1c014027dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "febb8d4c-5149-4e92-9363-4e502f0c1a6d", "tag": "a26f03e8-5797-4109-a4cb-c033343e086e"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:12.678735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-59ef30c4-f06b-40bc-959d-5dce31c650db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1759 microversion: 2.1 time: 0.318438 Sep 02 21:27:12.679476 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 297/638] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:12 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1759 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:12.691307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-c6006388-f880-41ea-b7ac-6f99c4d8b9cb req-023a0529-5df1-408f-829d-d1c014027dc5 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.692096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-c6006388-f880-41ea-b7ac-6f99c4d8b9cb req-023a0529-5df1-408f-829d-d1c014027dc5 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.692845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-c6006388-f880-41ea-b7ac-6f99c4d8b9cb req-023a0529-5df1-408f-829d-d1c014027dc5 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.708364 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-c6006388-f880-41ea-b7ac-6f99c4d8b9cb req-023a0529-5df1-408f-829d-d1c014027dc5 service nova] Creating event network-changed:a26f03e8-5797-4109-a4cb-c033343e086e for instance febb8d4c-5149-4e92-9363-4e502f0c1a6d on hv-cinder-85220 Sep 02 21:27:12.717072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-c6006388-f880-41ea-b7ac-6f99c4d8b9cb req-023a0529-5df1-408f-829d-d1c014027dc5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051530 Sep 02 21:27:12.718550 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 342/639] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:12.819973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:12.820972 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:12.834148 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.835140 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.840223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:12.840223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:12.840223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:12.840223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.069423 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:13.070361 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:13.082745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.085622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.085622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.085622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.085622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.086366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.275531 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:13.285894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-69d13049-e922-47ef-b756-adf3b1d5967c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.473350 Sep 02 21:27:13.286743 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 298/640] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:12 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:13.347482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:13.347482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:13.355372 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.356776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.360123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.361341 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.362080 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.362732 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.421253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:13.439238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-614067fc-325d-496b-8329-15d126e092e8 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.373973 Sep 02 21:27:13.440559 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 343/641] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:13 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:13.584818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:13.588811 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:13.595814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:13.597309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:13.598619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-418d5a4a-c04c-42a0-b69f-7705175932d2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1795 microversion: 2.20 time: 0.257354 Sep 02 21:27:13.599117 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 299/642] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:27:13 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1795 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:27:13.706423 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:13.709484 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:13.720892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.721961 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.722892 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.724030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:13.724877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:13.725614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:13.938857 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:13.953015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-625d808d-af58-444e-93e9-7542f6b9f869 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1503 microversion: 2.1 time: 0.264447 Sep 02 21:27:13.954345 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 344/643] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:13 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1503 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:14.005784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-52634188-0891-4ffb-abd0-bc24596c0bc5 req-ead2e7e0-4fc4-4168-864d-b6cb1b638672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb216c8b-c233-41d3-b655-87f77b8f2311", "name": "network-vif-deleted", "tag": "7ae3fcd6-e84f-491d-957b-485d5a0517d3"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:14.017687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-52634188-0891-4ffb-abd0-bc24596c0bc5 req-ead2e7e0-4fc4-4168-864d-b6cb1b638672 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.018198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-52634188-0891-4ffb-abd0-bc24596c0bc5 req-ead2e7e0-4fc4-4168-864d-b6cb1b638672 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.018638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-52634188-0891-4ffb-abd0-bc24596c0bc5 req-ead2e7e0-4fc4-4168-864d-b6cb1b638672 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.036158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-52634188-0891-4ffb-abd0-bc24596c0bc5 req-ead2e7e0-4fc4-4168-864d-b6cb1b638672 service nova] Creating event network-vif-deleted:7ae3fcd6-e84f-491d-957b-485d5a0517d3 for instance eb216c8b-c233-41d3-b655-87f77b8f2311 on hv-cinder-85220 Sep 02 21:27:14.041597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-52634188-0891-4ffb-abd0-bc24596c0bc5 req-ead2e7e0-4fc4-4168-864d-b6cb1b638672 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039653 Sep 02 21:27:14.042278 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 300/644] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:14.311660 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:14.312511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:14.318626 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.319116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.319544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.320234 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.320680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.321200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.469276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:14.470143 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:14.478127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.478620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.479085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.479789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.480303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.480866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.522567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:14.545503 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-da0f77cc-7001-4022-9deb-4db0a9db3df9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.238251 Sep 02 21:27:14.554620 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 345/645] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:14 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:14.762950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:14.770941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5deaa257-a1f4-4777-8735-e8650a20adde tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1317 microversion: 2.1 time: 0.307425 Sep 02 21:27:14.771876 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 301/646] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:14 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:14.978371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:14.978954 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:14.987535 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.988057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.988504 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:14.989253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:14.989714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:14.990180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.025190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.025673 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.026147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.026604 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lazy-loading 'fault' on Instance uuid eb216c8b-c233-41d3-b655-87f77b8f2311 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:15.075151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:15.093208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-198ccb6e-ae07-4efb-a6fc-509cbd578819 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1303 microversion: 2.1 time: 0.118464 Sep 02 21:27:15.094352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 346/647] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:14 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:15.570409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:15.571010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:15.578591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.579075 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.579515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.580237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.580714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.581149 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.801008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:15.801739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:15.809770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.811320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.811981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:15.812864 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:15.813419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:15.813962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.118283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:16.130631 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2950910a-e8a3-4d1b-be01-9b39b0fd852c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.564008 Sep 02 21:27:16.131736 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 302/648] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:15 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:16.140774 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:16.141648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:16.151036 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.151532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.152896 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.156561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.157346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.157613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.202324 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.204108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.204108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.204108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lazy-loading 'fault' on Instance uuid eb216c8b-c233-41d3-b655-87f77b8f2311 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:16.204696 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:16.213374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-71a01048-9dc7-4449-b7a5-799049ca06dd tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1506 microversion: 2.1 time: 0.416653 Sep 02 21:27:16.226462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 347/649] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:15 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1506 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:16.241047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3138717-96fe-4199-9fed-31c381459d35", "device": "/dev/sdb"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:16.245621 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:16.251085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:16.258268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.259199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.259922 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.261371 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:16.262427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:16.263212 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:16.271113 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:16.293331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e9df8add-76f3-4921-b4ec-151de72e617f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1303 microversion: 2.1 time: 0.159600 Sep 02 21:27:16.295031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 303/650] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:16 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:16.933687 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:17.156565 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:17.157187 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:17.164039 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.164910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.165341 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.165781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.166150 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.166587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.355613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:17.370428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e77f1a53-fffe-4bec-99f3-84b0facefca7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.218113 Sep 02 21:27:17.371164 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 304/651] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:17 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:17.378997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:17.380447 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:17.397426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.398321 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.405011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.405011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.405011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.405011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.465263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:17.466031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:17.467222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:17.467516 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lazy-loading 'fault' on Instance uuid eb216c8b-c233-41d3-b655-87f77b8f2311 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:17.525572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:17.535291 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3751cfe4-2681-4c77-b9b3-9fa5b625c12f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 200 len: 1303 microversion: 2.1 time: 0.162729 Sep 02 21:27:17.535783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 305/652] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:17 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 1303 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:17.927653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ec218ae4-61e4-4597-adaf-8f0aa1408307 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "POST /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.690452 Sep 02 21:27:17.928565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 348/653] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:27:16 2022] POST /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d/os-volume_attachments => generated 194 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:18.410228 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:18.410844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:18.417611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:18.418131 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:18.418583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.420215 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:18.420875 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:18.421356 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.561324 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:18.562159 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: eb216c8b-c233-41d3-b655-87f77b8f2311] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:18.567550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:18.570236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:18.570775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:18.571218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.571939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:18.572502 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:18.572938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:18.575991 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3637a25a-237e-4ef3-a780-1f32ae2e6858 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.169817 Sep 02 21:27:18.576567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 306/654] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:18 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:18.587585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] HTTP exception thrown: Instance eb216c8b-c233-41d3-b655-87f77b8f2311 could not be found. Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Request method failure captured: Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 HTTP/1.1 Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnT6raECmNwxqBYIuEOEhQq4lGPKrksBErvOngGtAtoasoYsE_G84Dk4aEEAuKUqT1F4Uq8POZb4RoF4wvyjvHcVyyBXpNnR_t0XCwfQoCQYBxTazmFSKBu-Prips2B8TAzemngBm07-NcPD5Dbbif0d_ZNK1cdFMjSSEU1IiwUs8s0 Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 00fbc2e7b83e496c9db6e8b0601ec81d Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesActionsTest-2097002959 Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:27:18.599382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/00fbc2e7b83e496c9db6e8b0601ec81d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_00fbc2e7b83e496c9db6e8b0601ec81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/00fbc2e7b83e496c9db6e8b0601ec81d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/00fbc2e7b83e496c9db6e8b0601ec81d"}]}] Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesActionsTest-2097002959 Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 00fbc2e7b83e496c9db6e8b0601ec81d Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesActionsTest-2097002959 Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesActionsTest-2097002959-project Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: f99376abecf24499b39dacbc7926e8c0 Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesActionsTest-2097002959-project Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance eb216c8b-c233-41d3-b655-87f77b8f2311 could not be found. Sep 02 21:27:18.600875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': 'eb216c8b-c233-41d3-b655-87f77b8f2311'} Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb216c8b-c233-41d3-b655-87f77b8f2311 could not be found. Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:27:18.601788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb216c8b-c233-41d3-b655-87f77b8f2311 could not be found. Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb216c8b-c233-41d3-b655-87f77b8f2311 could not be found. Sep 02 21:27:18.603352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:18.604745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Returning 404 to user: Instance eb216c8b-c233-41d3-b655-87f77b8f2311 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:27:18.604745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-622edba8-4b8e-45c0-b056-6811521e8e4e tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311" status: 404 len: 111 microversion: 2.1 time: 0.035177 Sep 02 21:27:18.604745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 349/655] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:18 2022] GET /compute/v2.1/servers/eb216c8b-c233-41d3-b655-87f77b8f2311 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:27:18.726602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-960084980", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "networks": [{"uuid": "5c60687e-6e60-428e-90d1-ab016d49d787"}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:18.785186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] validate_networks() for [('5c60687e-6e60-428e-90d1-ab016d49d787', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:27:19.215952 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:27:19.217033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:27:19.217635 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:27:19.218065 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:27:19.218557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:27:19.234867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.243170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.243170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.243170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.243170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.243620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.255582 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Getting quotas for project 00fbc2e7b83e496c9db6e8b0601ec81d. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:27:19.260127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Getting quotas for user f99376abecf24499b39dacbc7926e8c0 and project 00fbc2e7b83e496c9db6e8b0601ec81d. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:27:19.272840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:27:19.276107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:27:19.462745 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1d6246db-e092-4a37-ab97-1793763f4885 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.740178 Sep 02 21:27:19.469042 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 307/656] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:27:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:27:19.483359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5e527269-7862-4f95-961d-65433900de71 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:19.484221 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5e527269-7862-4f95-961d-65433900de71 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:19.544800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5e527269-7862-4f95-961d-65433900de71 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:19.556673 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5e527269-7862-4f95-961d-65433900de71 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1213 microversion: 2.1 time: 0.077177 Sep 02 21:27:19.591631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 350/657] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:19 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1213 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:19.601985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:19.602616 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:19.609421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.609935 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.610386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.611110 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:19.611597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:19.612043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:19.836915 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:19.848555 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-57c498d8-3a5d-4b9a-8ed6-3b40cbed2396 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.250468 Sep 02 21:27:19.849132 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 308/658] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:19 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:20.585753 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f2aa51ac-69a8-4851-8124-7b9fb477e376 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:20.587393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f2aa51ac-69a8-4851-8124-7b9fb477e376 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:20.667863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f2aa51ac-69a8-4851-8124-7b9fb477e376 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:20.676660 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f2aa51ac-69a8-4851-8124-7b9fb477e376 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1213 microversion: 2.1 time: 0.098315 Sep 02 21:27:20.677241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 351/659] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:20 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:20.875452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:20.876374 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:20.883656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.884149 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.884578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:20.885498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:20.886010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:20.886803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:21.061297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:21.077893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-64033dad-0f74-482b-9620-cb8b4a62c774 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.206593 Sep 02 21:27:21.079045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 309/660] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:20 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:21.708408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:21.710970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:21.728255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:21.729140 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:21.729970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:21.731219 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:21.732880 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:21.734596 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:21.839513 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:21.850917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c29cf57a-f31c-4df0-af6f-ae5b564b4a84 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1265 microversion: 2.1 time: 0.152853 Sep 02 21:27:21.851525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 352/661] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:21 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:22.108826 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:22.109838 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:22.118293 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:22.118910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:22.119495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:22.120706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:22.121199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:22.121715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:22.335146 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:22.349226 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2e510650-494a-4180-946b-de9d0c04ee85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.247624 Sep 02 21:27:22.350127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 310/662] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:22 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:22.876359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:22.877132 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:22.887213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:22.888570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:22.889207 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:22.890190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:22.890730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:22.891180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:22.993223 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:23.006096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-448f7448-7976-42b9-8e31-69a431732ee8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1265 microversion: 2.1 time: 0.135154 Sep 02 21:27:23.006851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 353/663] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:22 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:23.392421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:23.396060 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:23.415279 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:23.422567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:23.422892 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:23.423861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:23.424559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:23.425351 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:23.688338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:23.710995 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-40a7dbb8-bf27-4d98-b3ee-31699d87b917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1675 microversion: 2.1 time: 0.332436 Sep 02 21:27:23.712336 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 311/664] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:23 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1675 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:24.039553 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:24.040291 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:24.048793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:24.049439 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:24.050103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:24.051234 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:24.051866 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:24.052506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:24.157282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:24.172468 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d2ee72eb-7904-4a93-8799-636846baaa77 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1283 microversion: 2.1 time: 0.138199 Sep 02 21:27:24.181972 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 354/665] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:24 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1283 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:24.742393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:24.743080 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:24.750617 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:24.751111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:24.751551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:24.752308 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:24.752799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:24.753197 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:24.963278 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:24.975107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c80e9537-aa1b-4389-8fe5-abb610f6f69f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1652 microversion: 2.1 time: 0.236978 Sep 02 21:27:24.978832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 312/666] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:24 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1652 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:25.001400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c60a5cfd-0e6d-4708-b326-20df1e463905 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:25.010487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c60a5cfd-0e6d-4708-b326-20df1e463905 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.011902 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c60a5cfd-0e6d-4708-b326-20df1e463905 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.013227 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c60a5cfd-0e6d-4708-b326-20df1e463905 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.052656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c60a5cfd-0e6d-4708-b326-20df1e463905 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Going to try to start instance {{(pid=121512) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 02 21:27:25.198698 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:25.209480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:25.209480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.209480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.209480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.210102 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.210102 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.210102 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.342357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c60a5cfd-0e6d-4708-b326-20df1e463905 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/action" status: 202 len: 0 microversion: 2.1 time: 0.345599 Sep 02 21:27:25.343254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 355/667] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:27:24 2022] POST /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:27:25.352466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:25.353280 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:25.363022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.369270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.369270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.369270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:25.369270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:25.369883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:25.470382 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:25.495954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c3933bea-b966-4c59-88e6-c6d8b5422a11 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.301207 Sep 02 21:27:25.497265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 313/668] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:25 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:25.595087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:25.603805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8ec9616d-4eaf-4fa4-9a60-46cf2b59d7c4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1661 microversion: 2.1 time: 0.255652 Sep 02 21:27:25.604582 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 356/669] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:25 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1661 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:26.127020 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-03ad79ab-135e-49ff-ab7a-a997cec03c30 req-aa742cb2-426c-4a29-aae6-79bfb3fb0074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13c9e860-76ed-40de-b3f4-5db4fe915c3c", "tag": "fb33d1ea-9aff-43d8-906a-115b66b22019"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:26.141632 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-03ad79ab-135e-49ff-ab7a-a997cec03c30 req-aa742cb2-426c-4a29-aae6-79bfb3fb0074 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.142453 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-03ad79ab-135e-49ff-ab7a-a997cec03c30 req-aa742cb2-426c-4a29-aae6-79bfb3fb0074 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.143235 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-03ad79ab-135e-49ff-ab7a-a997cec03c30 req-aa742cb2-426c-4a29-aae6-79bfb3fb0074 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.159822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-03ad79ab-135e-49ff-ab7a-a997cec03c30 req-aa742cb2-426c-4a29-aae6-79bfb3fb0074 service nova] Creating event network-changed:fb33d1ea-9aff-43d8-906a-115b66b22019 for instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c on hv-cinder-85220 Sep 02 21:27:26.166043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-03ad79ab-135e-49ff-ab7a-a997cec03c30 req-aa742cb2-426c-4a29-aae6-79bfb3fb0074 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045441 Sep 02 21:27:26.169782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 314/670] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:26.533022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:26.536459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:26.542745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.545026 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.546105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.547114 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.547873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.548555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.630751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:26.631831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:26.643121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.646999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.650901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.651122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:26.651923 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:26.653227 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:26.856174 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:26.872805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8cb88475-eee1-4510-abcd-987f7994c11a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.343910 Sep 02 21:27:26.874040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 357/671] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:26 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:26.959226 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:26.970216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a193e22b-6896-48aa-8263-f434d1422175 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1661 microversion: 2.1 time: 0.344921 Sep 02 21:27:26.971332 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 315/672] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:26 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1661 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:27.900721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:27.901564 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:27.909956 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:27.909956 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:27.909956 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:27.910597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:27.910702 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:27.917019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:28.002040 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:28.002771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:28.012836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:28.012836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:28.014318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:28.014318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:28.014652 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:28.014980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:28.124419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:28.134152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6dd83e1c-1d66-4556-a30d-b51a0f69d47d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.237938 Sep 02 21:27:28.135154 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 358/673] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:27 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:28.203899 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:28.216080 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c9c90407-a824-4b53-8371-be74bd6297ba tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1661 microversion: 2.1 time: 0.220809 Sep 02 21:27:28.217485 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 316/674] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:27 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1661 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:29.159809 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:29.160526 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:29.169342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:29.169342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:29.169342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:29.169342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:29.169865 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:29.169959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:29.243693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:29.244520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:29.247754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:29.252827 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:29.256931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:29.256931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:29.256931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:29.256931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:29.257403 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:29.271473 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:29.348938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:29.358658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f31724d9-89d6-4a67-9b82-ce4ed8fa57e6 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.202490 Sep 02 21:27:29.370624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 359/675] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:29 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:29.426744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:29.430394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:29.436524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4d623efe-e6dc-48b1-a33a-0a5e7d42570e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1661 microversion: 2.1 time: 0.198370 Sep 02 21:27:29.437160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 317/676] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:29 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1661 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:30.389777 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:30.390436 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:30.398679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:30.399168 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:30.399602 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:30.400362 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:30.400813 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:30.401232 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:30.463223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:30.464034 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:30.471961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:30.472322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:30.472760 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:30.473454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:30.473939 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:30.474364 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:30.626858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:30.636059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-17bf6eb7-2550-4f11-a3e7-c60e166b80f8 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.250273 Sep 02 21:27:30.636656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 360/677] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:30 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:30.662752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:30.674753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a203f1b8-de20-4f37-b611-5d58ee46eebf tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1661 microversion: 2.1 time: 0.216116 Sep 02 21:27:30.675678 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 318/678] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:30 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1661 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:31.661204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:31.661748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:31.663792 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=4 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:31.669469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:31.669990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:31.670433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:31.671242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:31.671894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:31.672326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:31.706956 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:31.707788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:31.715543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:31.716301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:31.716820 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:31.717769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:31.718555 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:31.719403 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:31.878715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:31.890181 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5e23ff33-54b7-47bf-827a-1056d68709e3 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.232805 Sep 02 21:27:31.890778 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 361/679] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:31 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:31.910316 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:31.919805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e4b64b68-3c69-4c4e-b3e8-67f6b979c802 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1661 microversion: 2.1 time: 0.216368 Sep 02 21:27:31.920458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 319/680] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:31 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1661 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:32.913606 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:32.914233 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:32.921644 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:32.922156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:32.922588 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:32.923279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:32.923755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:32.924170 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:32.943894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:32.944519 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:32.946938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:32.952593 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:32.953073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:32.953506 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:32.954248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:32.954764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:32.955114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:33.140813 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:33.149104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e7e1ae0e-35e3-4a8c-b7fa-9f2bd1c309b0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.239295 Sep 02 21:27:33.149680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 362/681] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:32 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:33.154195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:33.169962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-78648fff-72db-4e4d-b128-a19bed30fcf4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1661 microversion: 2.1 time: 0.229723 Sep 02 21:27:33.170435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 320/682] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:32 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1661 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:34.173178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:34.173947 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:34.180572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:34.181059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:34.181572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:34.182301 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:34.182764 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:34.183195 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:34.200513 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:34.201170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:34.208434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:34.212167 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:34.212167 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:34.212167 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:34.212167 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:34.212500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:34.410622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:34.417009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:34.427011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f29a2d03-e251-4d71-8631-f07a5ef8120b tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.254184 Sep 02 21:27:34.427011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 363/683] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:34 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:34.427314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-08613a39-705f-4320-ba83-7067bcf8e917 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1665 microversion: 2.1 time: 0.230385 Sep 02 21:27:34.427314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 321/684] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:34 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1665 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:35.447718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:35.448451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:35.456459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:35.456950 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:35.457384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:35.458118 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:35.458570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:35.458995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:35.606018 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:35.613988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-07557a2b-0c2f-49e7-90c0-ab7928498fce tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.170135 Sep 02 21:27:35.614565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 364/685] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:35 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:36.646090 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:36.647182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:36.657324 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:36.657837 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:36.658275 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:36.658973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:36.659494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:36.659832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:36.980855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:36.990996 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d8f6b080-95c5-49e4-858d-e1003ecf5874 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.352816 Sep 02 21:27:36.991581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 322/686] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:36 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:38.016370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:38.019943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:38.024419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:38.024875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:38.025343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:38.026088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:38.026547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:38.026976 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:38.177592 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:38.186615 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-433bacaf-efd4-4cb0-883d-984cc859ef50 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.174259 Sep 02 21:27:38.187191 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 365/687] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:38 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:39.210330 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:39.211007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:39.218045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.219070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.219070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.219560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.220011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.220497 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.367828 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:39.378441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-78b6d487-3add-4299-b0d6-e44db7907329 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.172112 Sep 02 21:27:39.379125 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 323/688] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:39 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:39.457042 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:39.459999 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:39.468582 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.469337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.469905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.470775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.471414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.472032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.494262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:39.863711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d8c651ef-5ad9-4270-9e46-97b74745bb7e tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "POST /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/action" status: 202 len: 0 microversion: 2.1 time: 0.411889 Sep 02 21:27:39.864338 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 366/689] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:27:39 2022] POST /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:27:39.873281 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:39.873921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:39.880067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.880548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.880986 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:39.881689 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:39.882189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:39.882619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:40.035285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:40.044392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5365a71e-ff27-48b2-be4d-568ce11701a7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1751 microversion: 2.1 time: 0.175468 Sep 02 21:27:40.045048 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 324/690] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:39 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:40.404998 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:40.405920 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:40.415694 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:40.416485 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:40.417202 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:40.420217 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:40.421248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:40.422221 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:40.732184 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:40.741802 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8814e117-0a62-4445-a2ca-aad2ab7f1ae7 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.342663 Sep 02 21:27:40.742768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 367/691] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:40 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:41.015379 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-4727101a-df37-413d-9011-5d612bbdd4aa req-3bd2ef38-303e-42e6-8973-983efa943d33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c9e860-76ed-40de-b3f4-5db4fe915c3c", "name": "network-vif-plugged", "status": "completed", "tag": "fb33d1ea-9aff-43d8-906a-115b66b22019"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:41.026186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-4727101a-df37-413d-9011-5d612bbdd4aa req-3bd2ef38-303e-42e6-8973-983efa943d33 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:41.026976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-4727101a-df37-413d-9011-5d612bbdd4aa req-3bd2ef38-303e-42e6-8973-983efa943d33 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:41.027581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-4727101a-df37-413d-9011-5d612bbdd4aa req-3bd2ef38-303e-42e6-8973-983efa943d33 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:41.043476 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-4727101a-df37-413d-9011-5d612bbdd4aa req-3bd2ef38-303e-42e6-8973-983efa943d33 service nova] Creating event network-vif-plugged:fb33d1ea-9aff-43d8-906a-115b66b22019 for instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c on hv-cinder-85220 Sep 02 21:27:41.050466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-4727101a-df37-413d-9011-5d612bbdd4aa req-3bd2ef38-303e-42e6-8973-983efa943d33 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047526 Sep 02 21:27:41.051082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 325/692] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:41.069455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:41.070374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:41.077874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:41.084110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:41.084110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:41.084110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:41.084110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:41.084595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:41.337061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:41.346561 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-360e6554-d9ed-4e27-943c-a490cb8d60de tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1751 microversion: 2.1 time: 0.281275 Sep 02 21:27:41.347138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 368/693] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:41 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1751 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:41.772587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:41.773211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:41.784552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:41.785064 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:41.785515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:41.786264 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:41.786727 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:41.787160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:41.947005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:41.956441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e2a5df5b-90f6-4475-9079-bf4870d0e40f tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.188375 Sep 02 21:27:41.957283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 326/694] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:41 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:42.371550 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:42.372079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:42.381701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:42.382670 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:42.383424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:42.384985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:42.386587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:42.387451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:42.575846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:42.584914 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-58f7c7cc-3338-4708-82ac-1ff5b188cef4 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.217272 Sep 02 21:27:42.585495 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 369/695] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:42 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:42.897096 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:42.897903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:42.905302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:42.905891 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:42.906268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:42.906987 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:42.907452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:42.907875 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:42.989992 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:42.991279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:42.999219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lazy-loading 'services' on Instance uuid 78626e37-d502-477b-a62d-858b17bd287d {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:42.999988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:43.000786 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:43.001907 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:43.004453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:43.004973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:43.005485 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:43.171693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:43.181321 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-36c1b1e8-9b24-42ee-af99-e38d56918f06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.199251 Sep 02 21:27:43.181984 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 370/696] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:42 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:43.321706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-957efaed-402c-48d2-bc52-8ec572f507af tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d/os-volume_attachments/c3138717-96fe-4199-9fed-31c381459d35" status: 202 len: 0 microversion: 2.1 time: 0.428535 Sep 02 21:27:43.322265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 327/697] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:27:42 2022] DELETE /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d/os-volume_attachments/c3138717-96fe-4199-9fed-31c381459d35 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:27:43.609638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:43.610228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:43.617229 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:43.617720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:43.618183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:43.618891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:43.619348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:43.619774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:44.062867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:44.076743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f0f5458a-b329-44f6-8d83-3ac4dc7a58d7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.470854 Sep 02 21:27:44.077411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 371/698] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:43 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:44.205606 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:44.206346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:44.213445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:44.214762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:44.215087 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:44.215688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:44.216147 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:44.216576 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:44.375549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:44.384385 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-35c448d8-2ea4-4f42-8a61-56f56560fc06 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1313 microversion: 2.1 time: 0.183192 Sep 02 21:27:44.385237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 328/699] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:44 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:45.102619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:45.103197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:45.112128 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:45.112783 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:45.113229 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:45.113982 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:45.114442 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:45.114888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:45.326413 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:45.336722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e6b33cd4-e632-485c-bced-8f351ad11a17 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.238242 Sep 02 21:27:45.337479 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 372/700] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:45 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:45.416706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:45.418349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:45.425384 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:45.425922 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:45.426485 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:45.427237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:45.427970 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:45.428400 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:45.580644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:45.591429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8a4ff0d9-6b55-43b9-9107-1f488df3feda tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1498 microversion: 2.1 time: 0.178514 Sep 02 21:27:45.592013 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 329/701] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:45 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1498 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:46.363218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:46.363780 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:46.371248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:46.371948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:46.372491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:46.373483 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:46.374146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:46.374566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:46.596093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:46.606363 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3aae968c-5c5f-4779-bd1c-96f54920e118 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.247204 Sep 02 21:27:46.607047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 373/702] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:46 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:47.451840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:47.452492 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:47.460001 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.460495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.460935 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.461648 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.462146 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.462571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.492768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:27:47.630545 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:47.631247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:47.639597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.640091 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.640529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.641295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.641755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.642234 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.839613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7cfbaf49-f087-42d1-81a7-c8265b930179 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "DELETE /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 204 len: 0 microversion: 2.1 time: 0.391646 Sep 02 21:27:47.840245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 330/703] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:27:47 2022] DELETE /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 21:27:47.845771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:47.847509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:47.853244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.853739 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.854722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.855505 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.856134 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.856551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.891083 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:27:47.897041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:47.912584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7a4f9151-1b35-46f8-8eac-cf22e6afe275 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.285926 Sep 02 21:27:47.913583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 374/704] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:47 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:47.924676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:47.925393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:47.934261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.934261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.934261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.934261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:47.936271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:47.936271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:47.942775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:48.106886 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:48.115871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d3178d9f-9432-49ca-9954-5b7d9d36178d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1504 microversion: 2.1 time: 0.195297 Sep 02 21:27:48.119023 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 375/705] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:47 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1504 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:48.405445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e21b369f-a0f9-4ab0-9f64-e6d75f0384bc tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "DELETE /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 204 len: 0 microversion: 2.1 time: 0.563671 Sep 02 21:27:48.406082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 331/706] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:27:47 2022] DELETE /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:27:48.414916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:48.415542 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:48.422192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.422693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.423134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:48.423850 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.424306 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.424733 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:48.572596 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:48.584613 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0ade3c00-e933-440c-94db-69eaf3a1a589 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1512 microversion: 2.1 time: 0.173581 Sep 02 21:27:48.586409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 376/707] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:48 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1512 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:48.947682 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:48.948550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:48.956850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.957336 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.957767 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:48.958511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:48.958962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:48.959485 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:49.140115 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:49.141382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:49.142144 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:49.144539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=61 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:49.149380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b86eedca-fd4f-4a53-ad3d-3b761c4e47db tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.206139 Sep 02 21:27:49.151928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 332/708] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:48 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:49.153176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:49.154331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:49.154331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:49.155193 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:49.155754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:49.156252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:49.299699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:49.308610 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-788a98c5-ccd4-4cdc-8157-db332df4e21a tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1504 microversion: 2.1 time: 0.171300 Sep 02 21:27:49.309292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 377/709] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:49 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:49.610108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:49.610723 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:49.617005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:49.617492 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:49.617966 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:49.618674 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:49.619133 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:49.619584 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:49.775458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:49.785442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-49e821c5-4a01-4f78-be69-3b60d1f45a87 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1512 microversion: 2.1 time: 0.179240 Sep 02 21:27:49.786114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 333/710] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:49 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:50.174803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:50.183611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:50.183611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:50.183611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:50.183611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:50.184625 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:50.184625 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:50.184819 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:50.335599 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:50.336548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:50.347900 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:50.348688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:50.349140 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:50.349888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:50.350360 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:50.350794 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:50.366001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:50.376167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c09982a0-d579-47be-a12c-58709c546e07 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.204844 Sep 02 21:27:50.377483 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 378/711] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:50 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:50.494234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:50.503448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-adea2b4b-ca24-4b65-8de0-235adec11868 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1504 microversion: 2.1 time: 0.174632 Sep 02 21:27:50.504052 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 334/712] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:50 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:50.808650 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:50.809257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:50.815448 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:50.815938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:50.816370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:50.817068 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:50.817532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:50.818001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:50.957590 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:50.967297 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-db068f7b-5cf0-489d-9171-4cbe605361ae tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1512 microversion: 2.1 time: 0.162504 Sep 02 21:27:50.967899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 379/713] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:50 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:51.405455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:51.406124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:51.412844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:51.413326 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:51.413901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:51.414618 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:51.415071 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:51.415488 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:51.529068 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:51.530377 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:51.542231 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:51.542766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:51.543344 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:51.544105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:51.544560 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:51.545037 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:51.591125 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:51.601644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e54ee91e-c974-4031-a250-630f9f7785bc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.201709 Sep 02 21:27:51.602300 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 335/714] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:51 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:51.724310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:51.737693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a570589c-2d07-4188-9d75-56bf8bb22863 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1504 microversion: 2.1 time: 0.213311 Sep 02 21:27:51.741671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 380/715] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:51 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:51.996398 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:51.997508 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:52.005421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:52.005953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:52.006395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:52.007102 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:52.007562 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:52.007983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:52.168053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:52.178925 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dd9d08ba-7466-45f5-ad57-61f7062e3b33 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1512 microversion: 2.1 time: 0.190171 Sep 02 21:27:52.182427 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 336/716] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:51 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1512 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:52.636531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:52.637131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:52.644122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:52.644604 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:52.645043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:52.645744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:52.646244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:52.646666 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:52.775181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:52.781121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:52.783094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:52.783588 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:52.784029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:52.784735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:52.785189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:52.785618 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:52.854635 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:52.865516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e3f6e05c-b2fa-417d-9c71-65f9cb74afd1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.233807 Sep 02 21:27:52.866464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 381/717] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:52 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:52.970945 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:52.983434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-df4861b6-9dfa-4c2f-93cc-1476286320c0 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1504 microversion: 2.1 time: 0.214875 Sep 02 21:27:52.984161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 337/718] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:52 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:53.213527 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:53.214747 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:53.226717 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:53.227263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:53.227746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:53.228572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:53.229418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:53.229977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:53.234652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:27:53.401864 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:53.410437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-696ba522-bd6c-406f-8fef-7160d77af49c tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1512 microversion: 2.1 time: 0.204768 Sep 02 21:27:53.411048 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 382/719] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:53 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1512 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:53.894288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:53.895204 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:53.902242 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:53.902732 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:53.903170 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:53.903881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:53.904516 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:53.905248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:54.016418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:54.017363 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:54.024244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:54.025008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:54.025611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:54.026684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:54.027433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:54.028565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:54.108966 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:54.118433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-504466df-9fe6-46fc-a1ca-41f7c42c85c7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.229634 Sep 02 21:27:54.122444 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 338/720] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:53 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:54.195503 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:54.204122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-742aba1c-70dc-4dba-84bd-82d580d1c7ff tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1504 microversion: 2.1 time: 0.192687 Sep 02 21:27:54.217700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 383/721] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:54 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1504 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:54.438608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:54.439628 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:54.448685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:54.449705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:54.450546 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:54.451668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:54.452366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:54.453059 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:54.771715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:54.788613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-94b1142a-b3f2-4f95-89fc-f5db1b151533 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1512 microversion: 2.1 time: 0.351449 Sep 02 21:27:54.788613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 339/722] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:54 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:55.083531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-b8484549-accc-4a05-90ed-689acf6bdba4 req-5f350b1d-388a-4cc5-bb8e-ceb31433a2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78626e37-d502-477b-a62d-858b17bd287d", "name": "network-vif-deleted", "tag": "24f515c7-7e7f-4943-950f-12e8c25dc5ca"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:55.095343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-b8484549-accc-4a05-90ed-689acf6bdba4 req-5f350b1d-388a-4cc5-bb8e-ceb31433a2e2 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.095985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-b8484549-accc-4a05-90ed-689acf6bdba4 req-5f350b1d-388a-4cc5-bb8e-ceb31433a2e2 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.096859 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-b8484549-accc-4a05-90ed-689acf6bdba4 req-5f350b1d-388a-4cc5-bb8e-ceb31433a2e2 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.116198 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-b8484549-accc-4a05-90ed-689acf6bdba4 req-5f350b1d-388a-4cc5-bb8e-ceb31433a2e2 service nova] Creating event network-vif-deleted:24f515c7-7e7f-4943-950f-12e8c25dc5ca for instance 78626e37-d502-477b-a62d-858b17bd287d on hv-cinder-85220 Sep 02 21:27:55.125295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-b8484549-accc-4a05-90ed-689acf6bdba4 req-5f350b1d-388a-4cc5-bb8e-ceb31433a2e2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045236 Sep 02 21:27:55.134158 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 384/723] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:27:55.138851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-701cfa0a-a04b-416f-a242-d0d041349759 req-f785abdd-43bb-44fe-93c9-c29849c68fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c9e860-76ed-40de-b3f4-5db4fe915c3c", "name": "network-vif-deleted", "tag": "fb33d1ea-9aff-43d8-906a-115b66b22019"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:27:55.148026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-701cfa0a-a04b-416f-a242-d0d041349759 req-f785abdd-43bb-44fe-93c9-c29849c68fb3 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.148591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-701cfa0a-a04b-416f-a242-d0d041349759 req-f785abdd-43bb-44fe-93c9-c29849c68fb3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.149114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-701cfa0a-a04b-416f-a242-d0d041349759 req-f785abdd-43bb-44fe-93c9-c29849c68fb3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.155037 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:55.155752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:55.162518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.163008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.163456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.164188 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.164642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.165069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.173295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-701cfa0a-a04b-416f-a242-d0d041349759 req-f785abdd-43bb-44fe-93c9-c29849c68fb3 service nova] Creating event network-vif-deleted:fb33d1ea-9aff-43d8-906a-115b66b22019 for instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c on hv-cinder-85220 Sep 02 21:27:55.179839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-701cfa0a-a04b-416f-a242-d0d041349759 req-f785abdd-43bb-44fe-93c9-c29849c68fb3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047353 Sep 02 21:27:55.179839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 340/724] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:27:55.230925 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:55.233371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:55.243199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.243700 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.244339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.245984 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.246460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.247072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.334993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:55.342988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-eb18b8b6-426e-43af-8c39-c300da99c195 tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1462 microversion: 2.1 time: 0.118532 Sep 02 21:27:55.343566 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 341/725] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:55 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1462 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:55.378552 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:55.388338 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e3d1c100-5098-434b-a66e-3ee84a5027f2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.240450 Sep 02 21:27:55.388916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 385/726] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:55 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:55.814493 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:55.815849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:55.823769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.824431 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.824938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.825667 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.826191 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.826896 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.865860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:55.866366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:55.866866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:55.867531 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lazy-loading 'fault' on Instance uuid 78626e37-d502-477b-a62d-858b17bd287d {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:55.915883 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:55.923257 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b7e4d706-f27f-47eb-a681-62a9671e4123 tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1307 microversion: 2.1 time: 0.116766 Sep 02 21:27:55.923883 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 342/727] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:55 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1307 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:56.368663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:56.369803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:56.381226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.381617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.382101 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:56.382854 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.383310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.384009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:56.413820 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:56.414490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:56.420472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.421014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.421318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.421475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:56.421751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.422100 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lazy-loading 'fault' on Instance uuid 13c9e860-76ed-40de-b3f4-5db4fe915c3c {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:56.422277 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:56.422958 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.423417 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.423837 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:56.486019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:56.496249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8b2bae7b-2458-4ca0-8ce7-0e3f251e8d0c tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1303 microversion: 2.1 time: 0.131219 Sep 02 21:27:56.496858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 386/728] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:56 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:56.624321 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:56.635495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2bb2a05d-e86b-45de-9f42-2a74dfd68b44 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.225176 Sep 02 21:27:56.638422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 343/729] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:56 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:56.971906 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:56.972529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:56.979638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.980312 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.980757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:56.981458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:56.981942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:56.982375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:57.014952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:57.015517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:57.015957 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:57.016412 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lazy-loading 'fault' on Instance uuid 78626e37-d502-477b-a62d-858b17bd287d {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:57.061286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7431e8c106ba4e2689c0aa1001bbafe7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f6a7d90bafa459f8a24d89a10132b78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:57.069872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2e3911f1-662f-416f-a2e8-a9661225dc7e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 200 len: 1307 microversion: 2.1 time: 0.102369 Sep 02 21:27:57.070356 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 387/730] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:56 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:57.532479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:57.533361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:57.540072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:57.540565 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:57.541082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:57.542013 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:57.542393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:57.542831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:57.579781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:57.580278 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:57.580720 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:57.581176 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lazy-loading 'fault' on Instance uuid 13c9e860-76ed-40de-b3f4-5db4fe915c3c {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:27:57.636590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f99376abecf24499b39dacbc7926e8c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00fbc2e7b83e496c9db6e8b0601ec81d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:57.647945 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dea9d735-1455-4aba-8033-832af2098abf tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 200 len: 1303 microversion: 2.1 time: 0.119214 Sep 02 21:27:57.648664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 344/731] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:57 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 1303 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:27:57.661668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:57.663568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:57.669768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:57.669768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:57.669768 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:57.672179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:57.672179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:57.675373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:57.862220 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:57.871800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-22c67f00-a674-4681-9e13-784948540ab1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.215205 Sep 02 21:27:57.872403 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 388/732] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:57 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:27:58.093207 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:58.093829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] [instance: 78626e37-d502-477b-a62d-858b17bd287d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:58.100377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.101189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.101681 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.102460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.102946 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.103415 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.118764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] HTTP exception thrown: Instance 78626e37-d502-477b-a62d-858b17bd287d could not be found. Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Request method failure captured: Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d HTTP/1.1 Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnRxJyovjMshN4771B_Vtr34GUjWDWGzvSk-deexXkX0GaxN530AKdafF0s7SAE15RK2tf4hgKw_rl_EZV2XaTE9IjIfVAU3fw3DujKuJHFStIgA4a0gxFUq6NgpDv-DtNKy4oOq6bGRuarh67se5Ib5QVY-rgGGsiaC4WNSInEcaJI Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 5f6a7d90bafa459f8a24d89a10132b78 Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1187457843 Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:27:58.120502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/5f6a7d90bafa459f8a24d89a10132b78"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_5f6a7d90bafa459f8a24d89a10132b78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5f6a7d90bafa459f8a24d89a10132b78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/5f6a7d90bafa459f8a24d89a10132b78"}]}] Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-VolumesSnapshotTestJSON-1187457843 Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 5f6a7d90bafa459f8a24d89a10132b78 Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1187457843 Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-VolumesSnapshotTestJSON-1187457843-project Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: 7431e8c106ba4e2689c0aa1001bbafe7 Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-VolumesSnapshotTestJSON-1187457843-project Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 78626e37-d502-477b-a62d-858b17bd287d could not be found. Sep 02 21:27:58.125302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '78626e37-d502-477b-a62d-858b17bd287d'} Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78626e37-d502-477b-a62d-858b17bd287d could not be found. Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:27:58.126248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78626e37-d502-477b-a62d-858b17bd287d could not be found. Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78626e37-d502-477b-a62d-858b17bd287d could not be found. Sep 02 21:27:58.128246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.129611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] Returning 404 to user: Instance 78626e37-d502-477b-a62d-858b17bd287d could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:27:58.129611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0821985f-cdbd-4004-99e4-5e7fca52ee3e tempest-VolumesSnapshotTestJSON-1187457843 tempest-VolumesSnapshotTestJSON-1187457843-project] 10.222.0.79 "GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d" status: 404 len: 111 microversion: 2.1 time: 0.032714 Sep 02 21:27:58.129611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 345/733] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:58 2022] GET /compute/v2.1/servers/78626e37-d502-477b-a62d-858b17bd287d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:27:58.694325 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:58.695140 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] [instance: 13c9e860-76ed-40de-b3f4-5db4fe915c3c] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:58.702503 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.703022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.703452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.704218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.704676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.705109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.726598 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] HTTP exception thrown: Instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c could not be found. Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Request method failure captured: Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c HTTP/1.1 Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnT6raECmNwxqBYIuEOEhQq4lGPKrksBErvOngGtAtoasoYsE_G84Dk4aEEAuKUqT1F4Uq8POZb4RoF4wvyjvHcVyyBXpNnR_t0XCwfQoCQYBxTazmFSKBu-Prips2B8TAzemngBm07-NcPD5Dbbif0d_ZNK1cdFMjSSEU1IiwUs8s0 Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 00fbc2e7b83e496c9db6e8b0601ec81d Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesActionsTest-2097002959 Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:27:58.728320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/00fbc2e7b83e496c9db6e8b0601ec81d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_00fbc2e7b83e496c9db6e8b0601ec81d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/00fbc2e7b83e496c9db6e8b0601ec81d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/00fbc2e7b83e496c9db6e8b0601ec81d"}]}] Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesActionsTest-2097002959 Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 00fbc2e7b83e496c9db6e8b0601ec81d Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesActionsTest-2097002959 Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesActionsTest-2097002959-project Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: f99376abecf24499b39dacbc7926e8c0 Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesActionsTest-2097002959-project Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c could not be found. Sep 02 21:27:58.731146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '13c9e860-76ed-40de-b3f4-5db4fe915c3c'} Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c could not be found. Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:27:58.735618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c could not be found. Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c could not be found. Sep 02 21:27:58.737211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:27:58.738460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] Returning 404 to user: Instance 13c9e860-76ed-40de-b3f4-5db4fe915c3c could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:27:58.738460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-069e8f36-9b87-425c-aa53-c6f1695a601d tempest-VolumesActionsTest-2097002959 tempest-VolumesActionsTest-2097002959-project] 10.222.0.79 "GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c" status: 404 len: 111 microversion: 2.1 time: 0.041042 Sep 02 21:27:58.738460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 389/734] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:58 2022] GET /compute/v2.1/servers/13c9e860-76ed-40de-b3f4-5db4fe915c3c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:27:58.899816 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:27:58.902248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:27:58.909977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.910383 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.911063 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:58.913087 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:27:58.913841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:27:58.914243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:27:59.109215 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:27:59.120353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-691ffff4-1dd5-453c-9401-29f3171b290c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.225894 Sep 02 21:27:59.121072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 346/735] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:27:58 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:00.146577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:00.147922 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:00.155011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:00.155513 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:00.155956 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:00.156686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:00.157137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:00.157564 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:00.365435 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:00.377356 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-66338b36-ed89-49e3-bb1a-875d865d0086 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.235408 Sep 02 21:28:00.378090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 390/736] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:00 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:01.402919 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:01.403503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:01.410505 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:01.410996 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:01.411442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:01.412173 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:01.412631 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:01.413061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:01.588843 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:01.601516 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fe34b864-6c22-4def-ac3d-893171b1876f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.202698 Sep 02 21:28:01.602243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 347/737] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:01 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:02.626302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:02.626944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:02.629360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 21:28:02.629534 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Fri Sep 2 21:28:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d (ip 10.222.0.79) !!! Sep 02 21:28:02.639510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:02.640242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:02.644016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:02.644016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:02.644016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:02.644016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:02.828749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:02.838109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6a935c65-e738-4650-97b4-43327c7712e7 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.215639 Sep 02 21:28:02.838729 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 391/738] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:02 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:03.863833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:03.864800 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:03.868145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 21:28:03.868367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Fri Sep 2 21:28:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d (ip 10.222.0.79) !!! Sep 02 21:28:03.870878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:03.882742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:03.883602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:03.884061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:03.885510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:03.885999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:03.886431 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:03.907331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:04.038910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:04.048642 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-10c85e77-362e-44cd-9236-f87efaa139d1 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.188464 Sep 02 21:28:04.049220 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 348/739] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:03 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:05.072813 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:05.074182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:05.081798 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:05.081798 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:05.082119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:05.082824 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:05.083334 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:05.083757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:05.238260 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:05.246739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-cb0fabea-b50c-4603-8252-a72150be07da tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.177787 Sep 02 21:28:05.247366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 392/740] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:05 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:06.271089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:06.271709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:06.279299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:06.279787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:06.280919 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:06.281762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:06.282142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:06.288708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:06.444537 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:06.453481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-423621de-e6cb-4b5d-bde9-7ef8cc530f65 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.186825 Sep 02 21:28:06.454423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 349/741] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:06 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:07.476832 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:07.477528 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:07.490506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:07.490506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:07.490506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:07.490506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:07.490904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:07.490904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:07.640940 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:07.649409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-af5b3c65-9894-4483-b9d3-8903b36c914b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1756 microversion: 2.1 time: 0.176418 Sep 02 21:28:07.650017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 393/742] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:07 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:08.673339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:08.673990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:08.680223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:08.680709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:08.681152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:08.681879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:08.682343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:08.682945 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:08.839912 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:08.848731 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-27e61174-add2-4e60-8568-85fbffe177fc tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1759 microversion: 2.1 time: 0.179926 Sep 02 21:28:08.849310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 350/743] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:08 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:09.145015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b647289f-7a8b-4e5e-8645-409ee2ffd976"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:09.148561 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:09.155798 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.161580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.161580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:09.161580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:09.161580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:09.162190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:10.500973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7d127d06-40e1-42e8-8b5a-0ee016e831ef tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.477614 Sep 02 21:28:10.525072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 394/744] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:28:09 2022] POST /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments => generated 194 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:27.617705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=5 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:27.619314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=14 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:28.003500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:28.004604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:28.017018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.018404 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.019560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.021479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.022692 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.023902 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.094468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-675e4ea7-7722-4960-9730-ccc483094186 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments/7ac08439-45a1-4c8e-a52d-08ef81bb0e37" status: 200 len: 194 microversion: 2.20 time: 0.481962 Sep 02 21:28:28.095820 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 351/745] 10.222.0.79 () {60 vars in 1454 bytes} [Fri Sep 2 21:28:27 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments/7ac08439-45a1-4c8e-a52d-08ef81bb0e37 => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:28:28.250314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:28.252354 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:28.265658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=39 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:28.274172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:28.282933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.284345 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.286587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.289102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.289840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.291616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.578831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:28.581951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lazy-loading 'services' on Instance uuid 4f5852d6-c6ee-489d-a2cd-a1ce7008540f {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:28.585370 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:28.605469 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.610656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.611417 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.612419 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.612903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.613356 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.678680 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lazy-loading 'flavor' on Instance uuid 06870d3d-d4b2-4493-b4a9-c6e33f1824be {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:28.944307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d8f7a3ed-b39f-4ad6-8f52-04ffa99d5d01 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments/7ac08439-45a1-4c8e-a52d-08ef81bb0e37" status: 202 len: 0 microversion: 2.20 time: 0.705966 Sep 02 21:28:28.945250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 395/746] 10.222.0.79 () {60 vars in 1457 bytes} [Fri Sep 2 21:28:28 2022] DELETE /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments/7ac08439-45a1-4c8e-a52d-08ef81bb0e37 => generated 0 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:28:28.956214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:28.959505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:28.984497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.985652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.986064 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:28.987129 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:28.987821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:28.988789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:29.038868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b260073d-0b42-4f4b-a8e7-bc1d1822cbdf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088190 Sep 02 21:28:29.040076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 396/747] 10.222.0.79 () {60 vars in 1343 bytes} [Fri Sep 2 21:28:28 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:28:29.278265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5383429b-9244-46e7-ba14-aba8c1d98be7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/action" status: 200 len: 32 microversion: 2.1 time: 0.709336 Sep 02 21:28:29.284200 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 352/748] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:28:28 2022] POST /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/action => generated 32 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:28:29.295378 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:29.296060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:29.304659 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:29.305516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:29.306201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:29.307160 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:29.309210 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:29.309942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:29.661311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:29.675752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-77d5c193-f11d-49dd-8e75-b762b928b57e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.385233 Sep 02 21:28:29.676754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 397/749] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:29 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:30.065113 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:30.072865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:30.086345 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:30.087744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:30.089476 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:30.091353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:30.092451 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:30.096236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:30.170010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dc7b3caa-0ec6-4d30-bf22-637522602ca9 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105353 Sep 02 21:28:30.170010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 353/750] 10.222.0.79 () {60 vars in 1343 bytes} [Fri Sep 2 21:28:30 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:28:30.703872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:30.706400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:30.740282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:30.746479 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:30.747472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:30.757205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:30.758180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:30.759092 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:31.168770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:31.185493 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:31.194641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:31.195044 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bbc090ea-ea04-4d57-8597-4a2f82e2d18d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.494753 Sep 02 21:28:31.195044 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 398/751] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:30 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:31.201283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:31.203253 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:31.204196 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:31.205796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:31.206828 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:31.207715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:31.264425 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-14f0fddc-434c-4b3c-824c-d186cae87d77 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086861 Sep 02 21:28:31.265014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 354/752] 10.222.0.79 () {60 vars in 1343 bytes} [Fri Sep 2 21:28:31 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:28:32.232594 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:32.233603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:32.242107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.242848 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.243298 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.244088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.245096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.245573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.279807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:32.282433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:32.301062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.310029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.310029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.310029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.310029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.310799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.352685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-41eb2405-6613-4230-9c90-89aa0be68f9b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.077335 Sep 02 21:28:32.353885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 355/753] 10.222.0.79 () {60 vars in 1343 bytes} [Fri Sep 2 21:28:32 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:32.422685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:32.431760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e908b0b4-8c32-4852-b91c-b3770880eefc tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.203628 Sep 02 21:28:32.433185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 399/754] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:32 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:32.439086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:32.439331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:32.449970 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.450526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.451584 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.452350 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.452827 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.453257 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.482903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:28:32.876672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8324383d-c046-45df-abd5-4f69e8074be7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 204 len: 0 microversion: 2.20 time: 0.441421 Sep 02 21:28:32.878978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 356/755] 10.222.0.79 () {60 vars in 1280 bytes} [Fri Sep 2 21:28:32 2022] DELETE /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 02 21:28:32.891062 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:32.891905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:32.901190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.901883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.902703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:32.903294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:32.904581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:32.904581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:33.090456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:33.109161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:33.111567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:33.112957 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b077c78e-eddb-4dc7-a34f-9bd8d9b3fbba tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.229033 Sep 02 21:28:33.126129 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 400/756] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:32 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:33.458543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:33.459208 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:33.467961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:33.467961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:33.469662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:33.469662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:33.470192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:33.475532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:33.641122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:33.658697 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-53c33234-2d93-458a-b036-cc78f9c067e5 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.202992 Sep 02 21:28:33.659371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 357/757] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:33 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:34.156503 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:34.157149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:34.164290 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:34.164917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:34.165378 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:34.166105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:34.167885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:34.169212 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:34.348320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:34.358055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:34.359484 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:34.361422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fb4ff83c-26eb-4533-b34c-c5feab293d2d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.208780 Sep 02 21:28:34.362142 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 401/758] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:34 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:34.685471 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:34.686959 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:34.695186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:34.695934 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:34.696497 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:34.697254 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:34.697781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:34.698314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:34.857641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:34.867074 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c4e80786-1088-4ccb-8058-b2a5f27bbcc3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.186212 Sep 02 21:28:34.867654 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 358/759] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:34 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:35.389347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:35.392308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:35.400382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:35.400382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:35.400382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:35.400382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:35.401533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:35.401533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:35.563472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:35.573552 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:35.575642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:35.576891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-851cb185-79e0-4fd8-93fc-d302cf054cea tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.192603 Sep 02 21:28:35.577532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 402/760] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:35 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:35.897298 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:35.898376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:35.906856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:35.907348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:35.907786 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:35.908501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:35.908949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:35.909484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:36.141178 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:36.151553 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-608c0179-579d-4387-b54e-7aba7682e8b0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.259032 Sep 02 21:28:36.152059 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 359/761] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:35 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:36.603527 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:36.605054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:36.611882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:36.612376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:36.612820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:36.613533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:36.614031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:36.614460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:36.808733 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:36.821325 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:36.825572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:36.827093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7df50112-318a-450c-8288-547ad27e4753 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1723 microversion: 2.20 time: 0.227764 Sep 02 21:28:36.828020 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 403/762] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:36 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:37.180167 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:37.182295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:37.191031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:37.191921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:37.192782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:37.193665 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:37.194380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:37.195127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:37.368936 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-cec2652d-751a-46bc-98a2-726af13eb40f req-d375aeeb-06fd-4950-b808-f013d1b09b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5852d6-c6ee-489d-a2cd-a1ce7008540f", "name": "network-vif-deleted", "tag": "9c460ac1-1f81-408f-907d-b19a443be414"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:37.385963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-cec2652d-751a-46bc-98a2-726af13eb40f req-d375aeeb-06fd-4950-b808-f013d1b09b96 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:37.386747 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-cec2652d-751a-46bc-98a2-726af13eb40f req-d375aeeb-06fd-4950-b808-f013d1b09b96 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:37.387351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-cec2652d-751a-46bc-98a2-726af13eb40f req-d375aeeb-06fd-4950-b808-f013d1b09b96 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:37.405729 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-cec2652d-751a-46bc-98a2-726af13eb40f req-d375aeeb-06fd-4950-b808-f013d1b09b96 service nova] Creating event network-vif-deleted:9c460ac1-1f81-408f-907d-b19a443be414 for instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f on hv-cinder-85220 Sep 02 21:28:37.410634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:37.414013 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-cec2652d-751a-46bc-98a2-726af13eb40f req-d375aeeb-06fd-4950-b808-f013d1b09b96 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165206 Sep 02 21:28:37.415665 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 404/763] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:37.421715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a0a4b98f-fb5b-4f55-a8f5-b93383d4c98b tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.247094 Sep 02 21:28:37.441750 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 360/764] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:37 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:37.860424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:37.861656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:37.880990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:37.886374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:37.887043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:37.894937 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:37.895953 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:37.896685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:37.963305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:37.964267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:37.964928 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:37.965570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lazy-loading 'fault' on Instance uuid 4f5852d6-c6ee-489d-a2cd-a1ce7008540f {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:38.053486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:38.133118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:38.134478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:38.136932 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:38.138239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-deeb567c-953b-4fac-a438-b00a436b8360 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1372 microversion: 2.20 time: 0.286640 Sep 02 21:28:38.138611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:38.138807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 405/765] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:37 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1372 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:38.166284 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:38.166284 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:38.166284 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:38.167095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:38.167581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:38.168043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:38.225298 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8d3f3184-b57e-469e-aaac-c329f5b596a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097169 Sep 02 21:28:38.233499 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 361/766] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:28:38 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:28:38.452845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:38.453478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:38.464894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:38.466260 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:38.480280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:38.481022 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:38.481728 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:38.483039 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:38.484324 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:38.485515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:38.488305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:38.493656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:38.497409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:38.499112 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:38.500924 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:38.501977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:38.558855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:28:39.009125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-810cc748-47c2-4a86-a126-90ca6d63f9f7 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 204 len: 0 microversion: 2.1 time: 0.561384 Sep 02 21:28:39.012701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 406/767] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:28:38 2022] DELETE /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:28:39.022826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:39.023887 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:39.042189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:39.043088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:39.043803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:39.045763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:39.046488 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:39.051877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:39.117634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:39.129281 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1b7b7c7d-b061-4bf5-821e-5c0eb5d4eab4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.683794 Sep 02 21:28:39.132548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 362/768] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:38 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:39.177372 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:39.178229 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:39.187339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:39.188107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:39.188805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:39.189793 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:39.190492 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:39.191125 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:39.251911 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:39.253276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:39.254286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:39.254971 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lazy-loading 'fault' on Instance uuid 4f5852d6-c6ee-489d-a2cd-a1ce7008540f {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:39.261291 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:39.406815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:39.422354 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:39.427859 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:39.429244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4ffc8104-6dbd-4314-b9a9-10ad67b7da6d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1372 microversion: 2.20 time: 0.258553 Sep 02 21:28:39.435891 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 363/769] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:39 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1372 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:39.467762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:39.481766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f95ecfb8-73e6-4ef2-bc27-8ff520cb198c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1671 microversion: 2.1 time: 0.463197 Sep 02 21:28:39.482980 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 407/770] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:39 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1671 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:40.160336 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:40.160929 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:40.184337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.184847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.185303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:40.186097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.186577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.187013 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:40.356556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:40.366421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7ea29fce-88e6-45fe-bacf-4d9b2ecacde1 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.213420 Sep 02 21:28:40.367948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 364/771] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:40 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:40.458885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:40.459570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:40.467076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.467591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.468073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:40.468816 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.469275 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.469700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:40.505243 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.506021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.506479 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:40.506952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lazy-loading 'fault' on Instance uuid 4f5852d6-c6ee-489d-a2cd-a1ce7008540f {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:40.516192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:40.516559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:40.529980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.530599 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.531142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:40.532050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:40.532631 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:40.533160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:40.564773 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:40.574267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:40.575721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:40.577049 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1dc3546e-8b1a-488b-8df0-96b4229efffb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1372 microversion: 2.20 time: 0.123914 Sep 02 21:28:40.578719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 408/772] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:40 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1372 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:40.686277 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:40.699199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8f28966c-d9d9-4200-9638-91d61b8fe84c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1671 microversion: 2.1 time: 0.186800 Sep 02 21:28:40.704203 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 365/773] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:40 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:41.394295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:41.395277 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:41.403226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:41.403739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:41.404169 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:41.404973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:41.405427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:41.405925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:41.410627 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:41.554889 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:41.563422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-69320c8e-9d05-4887-9344-bd6d270a0809 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.173810 Sep 02 21:28:41.578001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 409/774] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:41 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:41.604615 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:41.605249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:41.612272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:41.612748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:41.613872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:41.613872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:41.614348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:41.614772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:41.648866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:41.649348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:41.649787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:41.650320 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lazy-loading 'fault' on Instance uuid 4f5852d6-c6ee-489d-a2cd-a1ce7008540f {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:41.701544 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:41.717555 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:41.719049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:41.720487 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2a9721fe-0594-42a0-b2eb-a6822b4b6144 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 200 len: 1372 microversion: 2.20 time: 0.120489 Sep 02 21:28:41.721295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 366/775] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:41 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 1372 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:41.736789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:41.737537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:41.744536 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:41.751699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:41.751699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:41.751699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:41.751699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:41.752102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:41.888748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:41.897474 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bf9e591b-6d8c-42b7-a490-3c0c10bf7b49 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1671 microversion: 2.1 time: 0.165217 Sep 02 21:28:41.898894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 410/776] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:41 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:42.601262 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:42.602162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:42.609922 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:42.610520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:42.610832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:42.611531 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:42.612027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:42.612426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:42.747053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:42.747875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:42.754529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:42.755041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:42.759266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:42.759266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:42.759266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:42.759266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:42.763892 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:42.772737 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] HTTP exception thrown: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:28:42.773082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3d86382b-4a39-4bb8-8e4c-76f9685c081d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.175721 Sep 02 21:28:42.774116 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 367/777] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:42 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Request method failure captured: Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f HTTP/1.1 Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQy71HF9KZ8UBg0-6XcTI45O71PUDqAblRMYVJiIGzJWEav4dOA1Yv0-JEGMa03gxRjZB2IE74GM_lXs4OyCvZBoqBc3siWSGmCYbkL4WDYmoHMNX81ir9S48qu4ytxuCNOHxaR8MdkSHf4bwevSgULMeIJi9w0GOKc7mId-_oKKtA Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:28:42.774573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}] Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: aa84378418324708b40f0791e2217ccc Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:28:42.776725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '4f5852d6-c6ee-489d-a2cd-a1ce7008540f'} Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:28:42.777664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:28:42.779095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:28:42.780236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Returning 404 to user: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:28:42.780236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4493fb5b-a4d4-4f1f-8bc5-cf5b22829c1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 404 len: 111 microversion: 2.20 time: 0.033712 Sep 02 21:28:42.780236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 411/778] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:42 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 21:28:42.786047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-44fcb587-b07a-481a-b22f-9f174e88638c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '.version_select at 0x7fb00cb5e280>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:42.921799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-44fcb587-b07a-481a-b22f-9f174e88638c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906605137" status: 204 len: 0 microversion: 2.20 time: 0.139637 Sep 02 21:28:42.922438 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 368/779] 10.222.0.79 () {60 vars in 1262 bytes} [Fri Sep 2 21:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906605137 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 21:28:42.925942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:42.925942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:42.932716 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:42.933203 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:42.933888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:42.934829 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:42.935355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:42.935843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:43.238595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:43.261847 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-db1354fc-282c-4946-8a72-83d5432b6f7e tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1671 microversion: 2.1 time: 0.342610 Sep 02 21:28:43.275861 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 412/780] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:42 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1671 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:43.798850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:43.800398 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:43.817025 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:43.818319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:43.818643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:43.819700 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:43.820573 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:43.821218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:44.025432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:44.035672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-92e5871d-6064-4b6c-9e51-296525fee565 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.241121 Sep 02 21:28:44.036346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 369/781] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:43 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:44.292698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:44.293628 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:44.301151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:44.302073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:44.302516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:44.303409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:44.303893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:44.304407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:44.479507 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:44.522007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0cd7a9aa-d626-403d-9c1e-14427c45df31 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1605 microversion: 2.1 time: 0.231539 Sep 02 21:28:44.523003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 413/782] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:44 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:45.000163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-65cce52f-cf58-4ca9-b586-555eb569c9c1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'create', calling method: .version_select at 0x7fb00cb07f70>, body: {"keypair": {"name": "tempest-keypair-112291069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRCPC3c3xrpR07lQ3hZXbwG0Q0RxZ6A4zKNhHRgZMsdmbF4usPKEYCs83b78+PwK+7XH7+XbcjSiKxuiF4ksFe/Zmo2dHNq/+fy7UxSRde0J2UdxrmKMG/MS/vquJjjlg=="}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:45.020821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-7c00f4f3-0c91-4754-9fc1-c2f1087117ff req-8a730364-6fff-432a-83ae-5a3d9e5d8cf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c79e24-443d-42bb-baa0-e9da52325154", "name": "network-vif-deleted", "tag": "6f431917-787d-4d70-8710-69f6656d5ead"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:45.041191 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-7c00f4f3-0c91-4754-9fc1-c2f1087117ff req-8a730364-6fff-432a-83ae-5a3d9e5d8cf2 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:45.044606 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-7c00f4f3-0c91-4754-9fc1-c2f1087117ff req-8a730364-6fff-432a-83ae-5a3d9e5d8cf2 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:45.046640 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-7c00f4f3-0c91-4754-9fc1-c2f1087117ff req-8a730364-6fff-432a-83ae-5a3d9e5d8cf2 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:45.050346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-65cce52f-cf58-4ca9-b586-555eb569c9c1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Getting quotas for project 6dbbc6a603794466b64e5822ea9a19f3. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:28:45.058790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-65cce52f-cf58-4ca9-b586-555eb569c9c1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Getting quotas for user aa84378418324708b40f0791e2217ccc and project 6dbbc6a603794466b64e5822ea9a19f3. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:28:45.095152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-7c00f4f3-0c91-4754-9fc1-c2f1087117ff req-8a730364-6fff-432a-83ae-5a3d9e5d8cf2 service nova] Creating event network-vif-deleted:6f431917-787d-4d70-8710-69f6656d5ead for instance c0c79e24-443d-42bb-baa0-e9da52325154 on hv-cinder-85220 Sep 02 21:28:45.110357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-7c00f4f3-0c91-4754-9fc1-c2f1087117ff req-8a730364-6fff-432a-83ae-5a3d9e5d8cf2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095152 Sep 02 21:28:45.111391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 414/783] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:45.126460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:45.127926 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:45.164567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:45.166139 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:45.166957 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:45.168248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:45.169469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:45.176800 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-65cce52f-cf58-4ca9-b586-555eb569c9c1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.181607 Sep 02 21:28:45.177246 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:45.184658 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 370/784] 10.222.0.79 () {62 vars in 1200 bytes} [Fri Sep 2 21:28:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 185 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 02 21:28:45.555845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:45.571402 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:45.576567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:45.582868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-142eff13-1d2d-4e5d-9766-f1d5b87664a2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.467306 Sep 02 21:28:45.600804 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 415/785] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:45 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:45.608873 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:45.611056 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:45.612327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:45.616201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:45.617085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:45.617931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:45.752643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:45.753895 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:45.758049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:45.758049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lazy-loading 'fault' on Instance uuid c0c79e24-443d-42bb-baa0-e9da52325154 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:28:45.920095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:45.947550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-58f40cf9-1967-4611-b5b6-99f9360bb16f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 200 len: 1327 microversion: 2.1 time: 0.383219 Sep 02 21:28:45.966633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 371/786] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:45 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 1327 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:46.640187 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:46.640914 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:46.655699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:46.657871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:46.658624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:46.660645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:46.667437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:46.668360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:46.979485 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:46.981038 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:47.000739 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:47.014456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:47.015819 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:47.016638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:47.019265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:47.022649 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:47.064434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] HTTP exception thrown: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Request method failure captured: Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 HTTP/1.1 Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQ0cpYDT6xtDTWg183OYZZfBGSp3Fw1VWLGQI7eNjCA2mf459JXZ8mFsND09DTUMv3-3HfJozSX2Xm6GeUDUyvfv47g7quRwMjyslG3Cl6goMUXcKUZXFw3McnyjnaSW3c3eViZWhnDminUBtrq2yfBBsy3NhPFFDV9dQCjrM-veZI Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:28:47.069458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}] Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: cceaf0c4877a4316af9d15c642c9dfc4 Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:28:47.071078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'c0c79e24-443d-42bb-baa0-e9da52325154'} Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:28:47.072292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:28:47.075041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:28:47.079198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Returning 404 to user: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:28:47.080893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c3a798ac-174e-47ed-99ac-24050a2e8a85 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 404 len: 111 microversion: 2.1 time: 0.107524 Sep 02 21:28:47.086320 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 372/787] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:46 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:28:47.105590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3881725d-3d12-465d-94da-b96e0a27e220 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '.version_select at 0x7fb00caf54c0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:47.167627 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:47.177792 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-93f2cc15-8c79-4d02-9b76-7a202de76601 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.544337 Sep 02 21:28:47.184933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 416/788] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:46 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:47.313366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3881725d-3d12-465d-94da-b96e0a27e220 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601535252" status: 202 len: 0 microversion: 2.1 time: 0.220813 Sep 02 21:28:47.314366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 373/789] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Sep 2 21:28:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601535252 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:28:48.219096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:48.220460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:48.243033 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:48.256834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:48.256834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:48.256834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:48.256834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:48.257350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:48.668153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:48.686088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4eaa49c2-4a82-4754-8549-cf9ff84dd52d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.473089 Sep 02 21:28:48.700412 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 417/790] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:48 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:48.996029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dd81e8ad-d6b5-4b31-81f1-8215ee5e4b6c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'create', calling method: .version_select at 0x7fb00cb18790>, body: {"keypair": {"name": "tempest-keypair-1863009305", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOw1gQYXTwXWCQQrWTAyEK0G4Z1LYSTHrdDOnOdlXKpnCacf1gkL0kU20yaEM/7r0pGjM5PRUwKXmbbETOkqVxdOYP54oVsMc6foa1emAqeMvCDxAnDuodlnIi7ntzDPDw=="}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:49.024272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-dd81e8ad-d6b5-4b31-81f1-8215ee5e4b6c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Getting quotas for project a7b20efaf7e440f9bbf2a1a0df19c556. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:28:49.029395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-dd81e8ad-d6b5-4b31-81f1-8215ee5e4b6c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Getting quotas for user cceaf0c4877a4316af9d15c642c9dfc4 and project a7b20efaf7e440f9bbf2a1a0df19c556. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:28:49.306415 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dd81e8ad-d6b5-4b31-81f1-8215ee5e4b6c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.313473 Sep 02 21:28:49.309240 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 374/791] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:28:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:28:49.714083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:49.716138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:49.735361 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:49.736235 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:49.736704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:49.737575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:49.738084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:49.750647 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:50.331907 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:50.355738 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-74c8ab24-7a45-4fa5-b4a1-03c72e244b8f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.647585 Sep 02 21:28:50.374800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 418/792] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:49 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:51.187433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-893249811", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8efd99c-ea04-4a0f-885a-18eabae1facd"}], "security_groups": [{"name": "tempest-securitygroup--1576812468"}], "key_name": "tempest-keypair-112291069", "user_data": "}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:51.386211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:51.387025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:51.396394 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:51.397177 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:51.397744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:51.398842 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:51.399494 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:51.400213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:51.419873 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] validate_networks() for [('e8efd99c-ea04-4a0f-885a-18eabae1facd', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:28:51.945495 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:51.963161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f2d4bc19-9eba-4f18-9171-47322b1c9540 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.578399 Sep 02 21:28:51.963161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 419/793] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:51 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:52.671258 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:28:52.672693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:28:52.673570 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:28:52.674180 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:28:52.674717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:28:52.754246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:52.754246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:52.754246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:52.754246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:52.755394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:52.755394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:52.778422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Getting quotas for project 6dbbc6a603794466b64e5822ea9a19f3. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:28:52.784006 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Getting quotas for user aa84378418324708b40f0791e2217ccc and project 6dbbc6a603794466b64e5822ea9a19f3. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:28:52.817644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:28:52.822126 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:28:52.839608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:52.974598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c2fa7c01-8224-4d46-9fcd-a4cdf6cba9fc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.791527 Sep 02 21:28:52.982532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 375/794] 10.222.0.79 () {62 vars in 1188 bytes} [Fri Sep 2 21:28:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1800 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 02 21:28:52.988985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a4ebf745-d902-4baf-8030-ccda9bbbfc81 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:52.989678 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a4ebf745-d902-4baf-8030-ccda9bbbfc81 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:52.994852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:52.995860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:53.003931 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:53.005082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:53.009755 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:53.012249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:53.022610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:53.022610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:53.110114 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a4ebf745-d902-4baf-8030-ccda9bbbfc81 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:53.127443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a4ebf745-d902-4baf-8030-ccda9bbbfc81 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:53.135190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a4ebf745-d902-4baf-8030-ccda9bbbfc81 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:53.136464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a4ebf745-d902-4baf-8030-ccda9bbbfc81 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1280 microversion: 2.20 time: 0.152808 Sep 02 21:28:53.158375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 420/795] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:52 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1280 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:53.375173 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:53.405693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0f009c54-833e-4393-aac0-0e491f68074e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.400083 Sep 02 21:28:53.405693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 376/796] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:52 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:53.949411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2009395121", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "79be0dde-dab1-4ca7-9d75-3bc2f5b94501"}], "security_groups": [{"name": "tempest-securitygroup--597664588"}], "key_name": "tempest-keypair-1863009305", "user_data": "}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:28:54.105559 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.network.neutron [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] validate_networks() for [('79be0dde-dab1-4ca7-9d75-3bc2f5b94501', None, None, None, None, None)] {{(pid=121512) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:28:54.172730 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7e4b33df-c0eb-4ef4-993f-34ec9702cceb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:54.173435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7e4b33df-c0eb-4ef4-993f-34ec9702cceb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:54.280880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7e4b33df-c0eb-4ef4-993f-34ec9702cceb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:54.298801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7e4b33df-c0eb-4ef4-993f-34ec9702cceb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:54.306198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7e4b33df-c0eb-4ef4-993f-34ec9702cceb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:54.307300 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7e4b33df-c0eb-4ef4-993f-34ec9702cceb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1280 microversion: 2.20 time: 0.137099 Sep 02 21:28:54.311557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 377/797] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:54 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1280 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:54.422781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:54.423948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:54.438885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:54.439558 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:54.440095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:54.440955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:54.441531 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:54.442106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:55.150377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:55.173463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9cd1da74-720e-433f-8e22-0adf1e127738 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.754956 Sep 02 21:28:55.178604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 378/798] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:54 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:28:55.346184 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:55.347114 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:55.370396 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:55.372463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:55.373574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:55.374904 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:55.375780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:55.377855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:55.421529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Flavor limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:28:55.428686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Image limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:28:55.428686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Flavor pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:28:55.428686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Image pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:28:55.429447 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:28:55.465011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:55.465718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:55.466497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:55.467502 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:55.467967 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:55.468646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:55.498342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:55.498692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Getting quotas for project a7b20efaf7e440f9bbf2a1a0df19c556. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:28:55.503938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Getting quotas for user cceaf0c4877a4316af9d15c642c9dfc4 and project a7b20efaf7e440f9bbf2a1a0df19c556. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:28:55.510236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:55.512767 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:55.519715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f2bb2fea-cfbe-41e6-9fc1-5fb2cce8c5f5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1276 microversion: 2.20 time: 0.177879 Sep 02 21:28:55.520669 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 379/799] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:55 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:55.523341 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Going to run 1 instances... {{(pid=121512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:28:55.526601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:28:55.749348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5b27cb95-6ab1-4cfc-a958-eea731aa0fe5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.806751 Sep 02 21:28:55.762643 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 421/800] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:28:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 21:28:55.772056 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-09a38d9f-6e8b-4fef-be31-bb250cb77967 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:55.773656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-09a38d9f-6e8b-4fef-be31-bb250cb77967 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:55.927766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-09a38d9f-6e8b-4fef-be31-bb250cb77967 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:55.951515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-09a38d9f-6e8b-4fef-be31-bb250cb77967 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1238 microversion: 2.1 time: 0.185017 Sep 02 21:28:55.975012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 380/801] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:55 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1238 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:56.211016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:56.213233 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:56.249271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.251262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.252412 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.254754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.256054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.256908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.549272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:56.551490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:56.570236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.574510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.575619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.576456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:56.577055 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:56.579069 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:56.619626 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:56.639183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ef7813e3-8fae-4f9f-a5c4-60205d184b1d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.435578 Sep 02 21:28:56.640050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 422/802] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:56 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:56.667063 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:56.681070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:56.683557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:56.685025 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-443618fe-c00b-4630-8cc3-819507209650 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1332 microversion: 2.20 time: 0.140496 Sep 02 21:28:56.694858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 381/803] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:56 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1332 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:56.999594 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ad55fc1e-ec23-4f7b-a1ec-4b2a5848a312 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:57.000480 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ad55fc1e-ec23-4f7b-a1ec-4b2a5848a312 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:57.182842 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ad55fc1e-ec23-4f7b-a1ec-4b2a5848a312 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:57.208594 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ad55fc1e-ec23-4f7b-a1ec-4b2a5848a312 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1238 microversion: 2.1 time: 0.214094 Sep 02 21:28:57.220651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 423/804] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:56 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1238 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:57.684033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:57.690428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:57.719631 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:57.724953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:57.724953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:57.725184 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:57.725653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:57.725738 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:57.725857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:57.725857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:57.738999 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:57.739988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:57.741355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:57.743805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:57.745433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:57.746246 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:57.927472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:57.943161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:57.976406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:57.982461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-edec7266-b275-4c50-b3f6-c9968d61acc3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1338 microversion: 2.20 time: 0.262047 Sep 02 21:28:58.000427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 424/805] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:57 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1338 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:28:58.048539 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:58.060907 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1de968d3-527e-4afa-9ef1-dabcd42810ec tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.390872 Sep 02 21:28:58.063186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 382/806] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:57 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:58.237019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:58.237469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:58.251303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:58.252118 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:58.252891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:58.254871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:58.259125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:58.260245 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:58.350335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:58.363623 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-64710add-3f28-4246-ad79-b4d3a41e4239 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1242 microversion: 2.1 time: 0.132020 Sep 02 21:28:58.364193 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 425/807] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:58 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1242 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:59.024438 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:59.034426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:59.051387 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.052029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.053734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.056585 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.057722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.058801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.091970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:59.092606 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:59.105945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:28:59.112453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.114509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.114509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.122057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.122932 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.123746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.475100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.490739 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.493532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.499091 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9caf870d-7b0e-4f52-a5e3-4df0f03b998c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.488068 Sep 02 21:28:59.512326 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 383/808] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:28:59 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:28:59.524393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:28:59.527887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:28:59.536415 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.537415 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.538095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.539509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:28:59.540283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:28:59.540974 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:28:59.575159 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.639581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-083ecb80-fae4-4040-a7a7-0d3b6afdaff6 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1737 microversion: 2.1 time: 0.551545 Sep 02 21:28:59.642554 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 426/809] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:59 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1737 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:28:59.759930 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:28:59.773358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f7f6662d-62ab-421a-bc2b-e887c785273d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1234 microversion: 2.1 time: 0.258389 Sep 02 21:28:59.775661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 384/810] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:28:59 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1234 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:00.266988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-492274231"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:00.269071 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:00.278981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.279509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.279950 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.280683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.281287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.282305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.327548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-a50be4c2-4d06-4c9b-b900-4f4805e4b656 req-076bbcbe-f878-4191-b14e-469ae88a5328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7327938c-75f2-41ec-9521-f46cdc14a597", "tag": "85b4ae9b-531e-4047-9428-d363ce87d94a"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:00.359649 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-a50be4c2-4d06-4c9b-b900-4f4805e4b656 req-076bbcbe-f878-4191-b14e-469ae88a5328 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.360706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-a50be4c2-4d06-4c9b-b900-4f4805e4b656 req-076bbcbe-f878-4191-b14e-469ae88a5328 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.362026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-a50be4c2-4d06-4c9b-b900-4f4805e4b656 req-076bbcbe-f878-4191-b14e-469ae88a5328 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.386296 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-a50be4c2-4d06-4c9b-b900-4f4805e4b656 req-076bbcbe-f878-4191-b14e-469ae88a5328 service nova] Creating event network-changed:85b4ae9b-531e-4047-9428-d363ce87d94a for instance 7327938c-75f2-41ec-9521-f46cdc14a597 on hv-cinder-85220 Sep 02 21:29:00.395264 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-a50be4c2-4d06-4c9b-b900-4f4805e4b656 req-076bbcbe-f878-4191-b14e-469ae88a5328 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073514 Sep 02 21:29:00.396346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 385/811] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:29:00.548929 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:00.549854 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:00.579464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.581181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.582165 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.582964 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:00.583449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:00.583921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:00.605587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.network.security_group_api [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Removing security group 5e47651a-fedb-40bd-b7f5-570ca3b8125d from port a26f03e8-5797-4109-a4cb-c033343e086e Sep 02 21:29:01.111846 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:01.149988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:01.158619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:01.161135 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9484f0b2-4cd2-46b0-b3aa-efdab50250cd tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.622210 Sep 02 21:29:01.188907 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 386/812] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:00 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:01.199511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:01.200239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:01.212690 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.213300 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.214032 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.215242 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.215897 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.216668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.294189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:01.731776 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-55700c03-eb94-411c-a81a-9735fce8b566 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "POST /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/action" status: 202 len: 0 microversion: 2.1 time: 1.459274 Sep 02 21:29:01.739680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 427/813] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:29:00 2022] POST /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/action => generated 0 bytes in 1478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:29:01.764983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:01.766458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:01.770833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:01.777030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.777870 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.778465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.781035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:01.782641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:01.783335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:01.797744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f48802de-6723-4df2-9dc4-7d8cdb12ad71 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1717 microversion: 2.1 time: 0.607234 Sep 02 21:29:01.807169 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 387/814] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:01 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1717 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:01.895584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:01.909295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-41f0e6e3-aec1-4673-80ca-8f6ce8d80aab tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1290 microversion: 2.1 time: 0.167506 Sep 02 21:29:01.913497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 428/815] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:01 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1290 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:02.002305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:02.002876 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:02.026561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.027523 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.028208 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.029567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.031910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.032782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.198040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:02.198935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:02.200610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] HTTP exception thrown: Cannot 'detach_volume' instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be while it is in vm_state rescued Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Request method failure captured: Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: DELETE /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments/b647289f-7a8b-4e5e-8645-409ee2ffd976 HTTP/1.1 Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQuA7tr86m4arxlUyz1sKUAwEHai_4Lbj-lbjLGsK0D8VwzMO5HYHfVyme-dtN2n9o9oDWjrb8bC4VcXT_A5AIzkitlo1KlXTYvF5IhqjNxpa-cx0MrRsLQ7OafI1s5xNuMBjK0TqgGEyiJR7OUFvdDhk0a1rWWQCmaEcIS6F4kp-I Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:29:02.203406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}] Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: c81bafbe3e444e84a7da18ac9d782479 Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:29:02.205691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Cannot 'detach_volume' instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be while it is in vm_state rescued Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'server_id': '06870d3d-d4b2-4493-b4a9-c6e33f1824be', 'id': 'b647289f-7a8b-4e5e-8645-409ee2ffd976'} Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:29:02.206852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be while it is in vm_state rescued Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be while it is in vm_state rescued Sep 02 21:29:02.208695 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:02.212696 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.214405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Returning 409 to user: Cannot 'detach_volume' instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be while it is in vm_state rescued {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:29:02.215571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.215701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fa6be23a-b79c-4575-98f7-0387f815b9ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "DELETE /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments/b647289f-7a8b-4e5e-8645-409ee2ffd976" status: 409 len: 152 microversion: 2.1 time: 0.217362 Sep 02 21:29:02.216117 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.224339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 388/816] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:29:01 2022] DELETE /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments/b647289f-7a8b-4e5e-8645-409ee2ffd976 => generated 152 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 21:29:02.224500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.224500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.224500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.230542 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:02.231605 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:02.240975 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.241570 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.245122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.246310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.246807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.247422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.521565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:02.550288 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:02.555466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:02.557098 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-60d35b9f-bb7c-4f7c-b3f3-2bb9373f04a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.365314 Sep 02 21:29:02.558591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 429/817] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:02 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:02.577766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-6dcd5e81-06ba-41ad-a02b-2c020a678312 req-1733d442-3016-43d5-bd9f-74d6938928d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "febb8d4c-5149-4e92-9363-4e502f0c1a6d", "tag": "a26f03e8-5797-4109-a4cb-c033343e086e"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:02.593875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-6dcd5e81-06ba-41ad-a02b-2c020a678312 req-1733d442-3016-43d5-bd9f-74d6938928d7 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.595310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-6dcd5e81-06ba-41ad-a02b-2c020a678312 req-1733d442-3016-43d5-bd9f-74d6938928d7 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.596776 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-6dcd5e81-06ba-41ad-a02b-2c020a678312 req-1733d442-3016-43d5-bd9f-74d6938928d7 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.613161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:02.624737 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-6dcd5e81-06ba-41ad-a02b-2c020a678312 req-1733d442-3016-43d5-bd9f-74d6938928d7 service nova] Creating event network-changed:a26f03e8-5797-4109-a4cb-c033343e086e for instance febb8d4c-5149-4e92-9363-4e502f0c1a6d on hv-cinder-85220 Sep 02 21:29:02.634604 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-6dcd5e81-06ba-41ad-a02b-2c020a678312 req-1733d442-3016-43d5-bd9f-74d6938928d7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071412 Sep 02 21:29:02.642063 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 430/818] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:02.703498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0249cfe2-bf07-4992-83b3-db54788fce69 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "POST /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/action" status: 202 len: 0 microversion: 2.1 time: 0.479035 Sep 02 21:29:02.706165 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 389/819] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:29:02 2022] POST /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:29:02.716139 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:02.717225 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:02.729438 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.730693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.741974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.754156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.754846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.755355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.940230 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:02.952823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:02.953705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:02.963895 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.964882 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.965980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:02.967222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:02.969634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:02.981875 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.191642 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.205051 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8f2e9523-43bc-446a-a6b4-e34897ff63b4 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1296 microversion: 2.1 time: 0.265548 Sep 02 21:29:03.210965 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 390/820] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:02 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1296 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:03.212329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.227511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5e1a97d1-470c-4f76-b6be-3fc0b01451bf tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1725 microversion: 2.1 time: 0.517642 Sep 02 21:29:03.228505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 431/821] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:02 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1725 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:03.586518 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:03.587455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:03.601229 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.601978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.602632 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.603592 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:03.604181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:03.605290 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:03.874406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.885650 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.887685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:03.893988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-bae57a7c-3e43-4d27-814f-84feb7165cb0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.309335 Sep 02 21:29:03.902054 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 391/822] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:03 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:04.236329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:04.236974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:04.245501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.246026 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.246464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.247176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.247634 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.248061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.256841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:04.258559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:04.265613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.266746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.267454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.268681 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.269408 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.270140 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.363411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:04.373630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5a23224b-5c2e-4699-bade-2787e1d99bb3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1296 microversion: 2.1 time: 0.141498 Sep 02 21:29:04.374847 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 432/823] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:04 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1296 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:04.630899 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:04.643517 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-196a120c-b07c-40f5-9f14-bc465b9f5e6d tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1725 microversion: 2.1 time: 0.392379 Sep 02 21:29:04.660653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 392/824] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:04 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1725 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:04.921555 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:04.922649 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:04.941017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.946704 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.946704 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:04.946704 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:04.947795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:04.949091 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.066885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a3935980-a298-4823-a424-bf077dbaa807 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Action: 'create', calling method: .version_select at 0x7fb00ca8f790>, body: {"keypair": {"name": "tempest-TestShelveInstance-267356359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEEQyB6TWBr0R82+1GzFjMuPQaibr0R7XXWwgVKE3xMsZFJETWVFygGHVML+At+HTcO4W/04OZBx1QL44RUwPp9os3M3vXdCKmL8gRShvgJHXAnPI6lTMxjvtiE7L00ipA=="}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:05.103059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-a3935980-a298-4823-a424-bf077dbaa807 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Getting quotas for project 184566a121dd41218042897eeff2b216. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:29:05.111490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-a3935980-a298-4823-a424-bf077dbaa807 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Getting quotas for user 1083cf32e76243ce9a88100374812ab7 and project 184566a121dd41218042897eeff2b216. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:29:05.205244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.217907 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.219600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.220817 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6bee0369-ed3e-4137-ab6b-a126950059e0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.308079 Sep 02 21:29:05.221480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 393/825] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:04 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:05.267671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a3935980-a298-4823-a424-bf077dbaa807 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.706247 Sep 02 21:29:05.268280 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 433/826] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:29:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:29:05.398977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:05.399898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:05.406948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.411210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.411210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.411210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.411210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.411937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.537495 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:05.543024 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:05.544184 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:05.558117 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.558983 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.559604 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.560684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.561489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.562326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.701329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lazy-loading 'services' on Instance uuid febb8d4c-5149-4e92-9363-4e502f0c1a6d {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:05.708546 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:05.751888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-221eebc0-4fc3-48ca-a70b-6c681e63cc06 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 0.357810 Sep 02 21:29:05.771353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 394/827] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:05 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:05.865427 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-31bd039a-f85e-4d15-b0dd-ab2c3f551f18 req-e1e6a664-c8a9-4c3b-a324-4c0b45a099f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "febb8d4c-5149-4e92-9363-4e502f0c1a6d", "tag": "a26f03e8-5797-4109-a4cb-c033343e086e"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:05.876481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-31bd039a-f85e-4d15-b0dd-ab2c3f551f18 req-e1e6a664-c8a9-4c3b-a324-4c0b45a099f5 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.877102 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-31bd039a-f85e-4d15-b0dd-ab2c3f551f18 req-e1e6a664-c8a9-4c3b-a324-4c0b45a099f5 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.878067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-31bd039a-f85e-4d15-b0dd-ab2c3f551f18 req-e1e6a664-c8a9-4c3b-a324-4c0b45a099f5 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.892881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-31bd039a-f85e-4d15-b0dd-ab2c3f551f18 req-e1e6a664-c8a9-4c3b-a324-4c0b45a099f5 service nova] Creating event network-changed:a26f03e8-5797-4109-a4cb-c033343e086e for instance febb8d4c-5149-4e92-9363-4e502f0c1a6d on hv-cinder-85220 Sep 02 21:29:05.899386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-31bd039a-f85e-4d15-b0dd-ab2c3f551f18 req-e1e6a664-c8a9-4c3b-a324-4c0b45a099f5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125804 Sep 02 21:29:05.900015 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 395/828] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:05.907073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:05.907947 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:05.915773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.916488 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.916890 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.917844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:05.918402 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:05.918951 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:05.940416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=18 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:06.099286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4f78675a-42e8-4c80-a8da-35dc4b81c690 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "DELETE /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments/28e4eb90-a4d7-47df-85a6-4f7f141979f0" status: 202 len: 0 microversion: 2.1 time: 0.562810 Sep 02 21:29:06.101954 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 434/829] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:29:05 2022] DELETE /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments/28e4eb90-a4d7-47df-85a6-4f7f141979f0 => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:29:06.111822 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:06.115391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:06.125267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.126058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.126670 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.127749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.128379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.129244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.130250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:06.141323 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-918d1616-9d88-4e82-803f-80c1d3f432c9 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1725 microversion: 2.1 time: 0.239139 Sep 02 21:29:06.141941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 396/830] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:05 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1725 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:06.171117 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-96ca5450-48b5-407e-8cd9-023398cfbf48 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064439 Sep 02 21:29:06.177027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 435/831] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:29:06 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:06.252239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:06.253269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:06.260845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.261639 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.262434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.263562 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.264336 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.264831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.469770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:06.480279 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:06.481799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:06.482965 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-34a9e259-4c1b-49c8-ae36-c0f373983033 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.236418 Sep 02 21:29:06.483522 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 397/832] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:06 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:06.782964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:06.783427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:06.797394 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.798349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.799214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:06.800568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:06.801485 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:06.802228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.170025 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:07.170734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:07.183767 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:07.186492 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:07.191095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.192111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:07.192880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:07.193489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.776638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:07.791506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-37fad76d-f2c4-4460-9e45-26a1e496a803 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 1.015260 Sep 02 21:29:07.808329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 436/833] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:06 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:07.817389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:07.819820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:07.827736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:07.828235 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:07.828725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.829471 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:07.829979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:07.830414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.875487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-45881eab-b4ad-4ffd-b935-7885aaa50804 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062353 Sep 02 21:29:07.876313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 437/834] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:29:07 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:07.881962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:07.882988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:07.891386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:07.891386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:07.895014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.895014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:07.895014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:07.895014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:07.895630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:07.905042 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-09003696-2f1c-4a9f-a662-167663749824 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1725 microversion: 2.1 time: 0.739667 Sep 02 21:29:07.935176 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 398/835] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:07 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1725 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:08.067233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-f867bc07-b94a-474a-821d-3cb248af28ea req-d1a4deec-87e4-4cfc-ab04-59cf848b62be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd", "tag": "cf9887ef-2cab-4e48-ae3a-5e3ed887dcb2"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:08.097869 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:08.102835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-f867bc07-b94a-474a-821d-3cb248af28ea req-d1a4deec-87e4-4cfc-ab04-59cf848b62be service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:08.102835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-f867bc07-b94a-474a-821d-3cb248af28ea req-d1a4deec-87e4-4cfc-ab04-59cf848b62be service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:08.102835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-f867bc07-b94a-474a-821d-3cb248af28ea req-d1a4deec-87e4-4cfc-ab04-59cf848b62be service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:08.116228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:08.119519 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:08.121931 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f7710b76-21aa-48d3-8187-d8b2c3efa503 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.244706 Sep 02 21:29:08.122969 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 438/836] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:07 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:08.146505 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-f867bc07-b94a-474a-821d-3cb248af28ea req-d1a4deec-87e4-4cfc-ab04-59cf848b62be service nova] Creating event network-changed:cf9887ef-2cab-4e48-ae3a-5e3ed887dcb2 for instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd on hv-cinder-85220 Sep 02 21:29:08.151864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-f867bc07-b94a-474a-821d-3cb248af28ea req-d1a4deec-87e4-4cfc-ab04-59cf848b62be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088928 Sep 02 21:29:08.152746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 399/837] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:08.764627 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-c4b1bfee-5af1-493a-a2d6-1f2fc1266460 req-ce93b6c8-9ef2-4cf1-9a96-c168dbb458f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7327938c-75f2-41ec-9521-f46cdc14a597", "name": "network-vif-plugged", "status": "completed", "tag": "85b4ae9b-531e-4047-9428-d363ce87d94a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:08.787104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-c4b1bfee-5af1-493a-a2d6-1f2fc1266460 req-ce93b6c8-9ef2-4cf1-9a96-c168dbb458f0 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:08.787883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-c4b1bfee-5af1-493a-a2d6-1f2fc1266460 req-ce93b6c8-9ef2-4cf1-9a96-c168dbb458f0 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:08.788545 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-c4b1bfee-5af1-493a-a2d6-1f2fc1266460 req-ce93b6c8-9ef2-4cf1-9a96-c168dbb458f0 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:08.811933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-c4b1bfee-5af1-493a-a2d6-1f2fc1266460 req-ce93b6c8-9ef2-4cf1-9a96-c168dbb458f0 service nova] Creating event network-vif-plugged:85b4ae9b-531e-4047-9428-d363ce87d94a for instance 7327938c-75f2-41ec-9521-f46cdc14a597 on hv-cinder-85220 Sep 02 21:29:08.821978 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-c4b1bfee-5af1-493a-a2d6-1f2fc1266460 req-ce93b6c8-9ef2-4cf1-9a96-c168dbb458f0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159397 Sep 02 21:29:08.824742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:08.824985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 439/838] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:08.825475 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:08.846636 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:08.847146 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:08.847611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:08.853016 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:08.853545 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:08.856095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:08.892548 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:08.896580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:08.911966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:08.914811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:08.918491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:08.921947 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:08.922602 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:08.923314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.008269 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f26f43c4-fc60-4959-ac94-9e2bf606068f tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120517 Sep 02 21:29:09.028939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 440/839] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:29:08 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:09.034453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:09.035339 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:09.044293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.050529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.051216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.053606 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.054640 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.056509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.264198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.283358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-65a4539b-475a-480a-8e1a-28ac643916b1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 0.466143 Sep 02 21:29:09.285181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 400/840] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:08 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:09.296784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:09.297409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:09.316797 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.317297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.317746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.318541 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.323412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.324136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.435360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.451461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2e57e59e-c153-4a88-a381-1ae29854da68 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1731 microversion: 2.1 time: 0.420776 Sep 02 21:29:09.452446 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 441/841] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:09 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1731 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:09.497334 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:09.502685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:09.531963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.532748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.533360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.535460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:09.536771 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:09.538044 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:09.647234 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.660938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.663094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:09.665049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dcadbdf7-5607-4fcd-8359-36f6848a6190 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.375341 Sep 02 21:29:09.665857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 401/842] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:09 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:09.673408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e68bca00-8fbc-421f-a06b-6f0b401da77a tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.198937 Sep 02 21:29:09.674827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 442/843] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Sep 2 21:29:09 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:29:10.032350 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:10.035570 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:10.044590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.057630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.057630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.057630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.057630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.058726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.114771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7da9d1ae-45dd-424b-af41-9fa1b80c18a0 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088331 Sep 02 21:29:10.115981 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 402/844] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:29:10 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:29:10.128579 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:10.129740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:10.141448 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.142689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.143707 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.144765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.145466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.146543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.301197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] HTTP exception thrown: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d is not attached to volume 28e4eb90-a4d7-47df-85a6-4f7f141979f0 Sep 02 21:29:10.310404 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:10.311022 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Request method failure captured: Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments/28e4eb90-a4d7-47df-85a6-4f7f141979f0 HTTP/1.1 Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnTAANkCm1nWuYtDCWoEvb7P9yJNjJTDIhjHXWXQM_1ij_HCdGHLU3s0GxP9fpeY11fx9eLMvdv1FL5kAfXPO2RJkD6gOAumYzgAC7z7CAts5UnwPmzhy64IoLf-4ubUv4l_C-W-0T-JZUA0SZBu-UnOz0UTXSa9GeNVO7MpodubU4o Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 2a715e1b8137477b9f39b1d6d8d0d268 Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-TestMinimumBasicScenario-151998427 Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:29:10.315254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a715e1b8137477b9f39b1d6d8d0d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a715e1b8137477b9f39b1d6d8d0d268"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a715e1b8137477b9f39b1d6d8d0d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a715e1b8137477b9f39b1d6d8d0d268"}]}] Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-TestMinimumBasicScenario-151998427 Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 2a715e1b8137477b9f39b1d6d8d0d268 Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-TestMinimumBasicScenario-151998427 Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-TestMinimumBasicScenario-151998427-project Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: b0884441f5744f09b23823752684fe08 Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-TestMinimumBasicScenario-151998427-project Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:29:10.316912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d is not attached to volume 28e4eb90-a4d7-47df-85a6-4f7f141979f0 Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'server_id': 'febb8d4c-5149-4e92-9363-4e502f0c1a6d', 'id': '28e4eb90-a4d7-47df-85a6-4f7f141979f0'} Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 28e4eb90-a4d7-47df-85a6-4f7f141979f0. Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:29:10.317714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d is not attached to volume 28e4eb90-a4d7-47df-85a6-4f7f141979f0 Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d is not attached to volume 28e4eb90-a4d7-47df-85a6-4f7f141979f0 Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:29:10.318877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Returning 404 to user: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d is not attached to volume 28e4eb90-a4d7-47df-85a6-4f7f141979f0 {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:29:10.319870 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-445bcb3a-be19-4b7f-a5ae-ffdb5faefb26 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "DELETE /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments/28e4eb90-a4d7-47df-85a6-4f7f141979f0" status: 404 len: 154 microversion: 2.1 time: 0.192856 Sep 02 21:29:10.319870 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 443/845] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:29:10 2022] DELETE /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d/os-volume_attachments/28e4eb90-a4d7-47df-85a6-4f7f141979f0 => generated 154 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:29:10.322905 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.323859 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.324480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.325359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.326009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.326631 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.550539 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:10.563267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-21148a99-fc14-4023-8666-93a29fc680a1 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 0.256023 Sep 02 21:29:10.564384 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 403/846] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:10 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:10.715605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:10.716219 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:10.724951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.726355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.727204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.728107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:10.728721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:10.729683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:10.981757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:10.991819 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:10.993589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:10.994880 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1bb2cc96-3161-4658-930f-2dd40ac54b2f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.295339 Sep 02 21:29:10.995674 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 444/847] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:10 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:11.171380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-b1705f9c-2b84-4e6a-a766-d57403d65726 req-478fc834-4348-43bd-b7d7-40124f485949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06870d3d-d4b2-4493-b4a9-c6e33f1824be", "tag": "737355df-9df5-464b-b327-d997ff9abc7a"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:11.194315 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b1705f9c-2b84-4e6a-a766-d57403d65726 req-478fc834-4348-43bd-b7d7-40124f485949 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.197449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b1705f9c-2b84-4e6a-a766-d57403d65726 req-478fc834-4348-43bd-b7d7-40124f485949 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.197449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b1705f9c-2b84-4e6a-a766-d57403d65726 req-478fc834-4348-43bd-b7d7-40124f485949 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:11.208366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-b1705f9c-2b84-4e6a-a766-d57403d65726 req-478fc834-4348-43bd-b7d7-40124f485949 service nova] Creating event network-changed:737355df-9df5-464b-b327-d997ff9abc7a for instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be on hv-cinder-85220 Sep 02 21:29:11.214056 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-b1705f9c-2b84-4e6a-a766-d57403d65726 req-478fc834-4348-43bd-b7d7-40124f485949 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047977 Sep 02 21:29:11.214744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 404/848] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:11.588075 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:11.588620 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:11.595463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.595965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.596400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:11.597291 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.597948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.601833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:11.712840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:11.713430 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:11.720058 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.720718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.721296 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:11.722112 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:11.722711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:11.723066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:11.729003 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:11.753779 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:29:11.768387 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:11.804603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0e7e9bff-692d-4b43-943c-c3527878de2f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 0.194718 Sep 02 21:29:11.804603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 445/849] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:11 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:12.024891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:12.032620 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:12.041407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:12.042965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:12.042965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.043202 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:12.043644 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:12.051461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.260152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.274324 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.277282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.278923 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-45272299-699e-4207-b160-d82c7319806f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1406 microversion: 2.20 time: 0.259140 Sep 02 21:29:12.279390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 446/850] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:12 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1406 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:29:12.436621 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-bb18992c-5232-4e09-9e8c-ea66259af518 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "DELETE /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 204 len: 0 microversion: 2.1 time: 0.729686 Sep 02 21:29:12.437491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 405/851] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:29:11 2022] DELETE /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 0 bytes in 732 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:29:12.452014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:12.452667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:12.471296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:12.476639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:12.479175 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.479963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:12.480444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:12.487114 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.662219 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.674826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-90b2812c-0186-4f4c-9ecb-6c35e8e5202b tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1554 microversion: 2.1 time: 0.231720 Sep 02 21:29:12.680445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 447/852] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:12 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:12.803754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:12.805418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:12.814571 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:12.815057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:12.818954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.818954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:12.818954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:12.818954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:12.988342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:12.999718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c42fbf54-2d17-4282-a908-8ee5a4ba292c tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 0.200051 Sep 02 21:29:13.000302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 406/853] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:12 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:13.232774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-058ba66e-d210-4ce2-b8ad-931747ed221d req-0086e713-bb6a-4874-a40d-976f1f6dfb1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06870d3d-d4b2-4493-b4a9-c6e33f1824be", "tag": "737355df-9df5-464b-b327-d997ff9abc7a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:13.243731 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-058ba66e-d210-4ce2-b8ad-931747ed221d req-0086e713-bb6a-4874-a40d-976f1f6dfb1f service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.244334 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-058ba66e-d210-4ce2-b8ad-931747ed221d req-0086e713-bb6a-4874-a40d-976f1f6dfb1f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.244847 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-058ba66e-d210-4ce2-b8ad-931747ed221d req-0086e713-bb6a-4874-a40d-976f1f6dfb1f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.258858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-058ba66e-d210-4ce2-b8ad-931747ed221d req-0086e713-bb6a-4874-a40d-976f1f6dfb1f service nova] Creating event network-changed:737355df-9df5-464b-b327-d997ff9abc7a for instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be on hv-cinder-85220 Sep 02 21:29:13.264380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-058ba66e-d210-4ce2-b8ad-931747ed221d req-0086e713-bb6a-4874-a40d-976f1f6dfb1f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036821 Sep 02 21:29:13.265073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 448/854] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:13.315501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:13.316878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:13.325331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.325998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.326549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.327472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.328367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.328845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.489592 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:13.498404 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:13.501993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:13.501993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5b94ae06-bf91-4e8e-b704-7dbccf4001bb tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1598 microversion: 2.20 time: 0.192552 Sep 02 21:29:13.501993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 407/855] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:29:13 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1598 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:29:13.529538 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:13.530206 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:13.536548 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.537040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.537506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.538812 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.539282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.539695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.565357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:13.638963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f3d2fec6-fa21-481a-b2fb-960f4a8e7c10 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113727 Sep 02 21:29:13.639608 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 449/856] 10.222.0.79 () {60 vars in 1316 bytes} [Fri Sep 2 21:29:13 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:29:13.701199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:13.702160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:13.708868 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.709653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.710683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.711710 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:13.712184 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:13.712610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:13.951084 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:13.960059 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ce347704-8124-40af-9ee2-3106b3e5f241 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1554 microversion: 2.1 time: 0.264231 Sep 02 21:29:13.960989 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 408/857] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:13 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1554 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:14.026009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:14.026815 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:14.034372 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:14.034863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:14.035296 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:14.040085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:14.040085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:14.040085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:14.278627 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:14.295105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8943792e-fb32-453b-9254-7299063f6393 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 0.273014 Sep 02 21:29:14.296540 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 450/858] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:14 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:14.559058 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-e25c8f17-ef69-489d-a139-3da00f05e356 req-f7799189-53ae-4c8e-b83a-d942ce4a0af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd", "name": "network-vif-plugged", "status": "completed", "tag": "cf9887ef-2cab-4e48-ae3a-5e3ed887dcb2"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:14.602762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e25c8f17-ef69-489d-a139-3da00f05e356 req-f7799189-53ae-4c8e-b83a-d942ce4a0af9 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:14.603511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e25c8f17-ef69-489d-a139-3da00f05e356 req-f7799189-53ae-4c8e-b83a-d942ce4a0af9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:14.603749 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e25c8f17-ef69-489d-a139-3da00f05e356 req-f7799189-53ae-4c8e-b83a-d942ce4a0af9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:14.618749 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-e25c8f17-ef69-489d-a139-3da00f05e356 req-f7799189-53ae-4c8e-b83a-d942ce4a0af9 service nova] Creating event network-vif-plugged:cf9887ef-2cab-4e48-ae3a-5e3ed887dcb2 for instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd on hv-cinder-85220 Sep 02 21:29:14.624209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-e25c8f17-ef69-489d-a139-3da00f05e356 req-f7799189-53ae-4c8e-b83a-d942ce4a0af9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072320 Sep 02 21:29:14.624823 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 409/859] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:14.988856 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:14.992432 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:15.001985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.003570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.003570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.004180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.004815 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.005250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.130765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=14 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:15.289254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:15.302512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6875694c-278b-4edf-972d-c4515a72088c tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1554 microversion: 2.1 time: 0.321696 Sep 02 21:29:15.319934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 451/860] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:14 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1554 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:15.344822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:15.350390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:15.359558 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.360195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.360784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.361672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.362168 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.362751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.675764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:15.693706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-066fa422-29d2-4dfc-801e-9ba440c674b3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 0.362993 Sep 02 21:29:15.693939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-ba708107-152a-4bd9-9ebf-880c12c9e3bc req-bd80411d-1bd8-4ed4-a1d3-3023e9b06d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7327938c-75f2-41ec-9521-f46cdc14a597", "tag": "85b4ae9b-531e-4047-9428-d363ce87d94a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:15.695852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 410/861] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:15 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:15.717398 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-ba708107-152a-4bd9-9ebf-880c12c9e3bc req-bd80411d-1bd8-4ed4-a1d3-3023e9b06d72 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.718196 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-ba708107-152a-4bd9-9ebf-880c12c9e3bc req-bd80411d-1bd8-4ed4-a1d3-3023e9b06d72 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.718788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-ba708107-152a-4bd9-9ebf-880c12c9e3bc req-bd80411d-1bd8-4ed4-a1d3-3023e9b06d72 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:15.735962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-ba708107-152a-4bd9-9ebf-880c12c9e3bc req-bd80411d-1bd8-4ed4-a1d3-3023e9b06d72 service nova] Creating event network-changed:85b4ae9b-531e-4047-9428-d363ce87d94a for instance 7327938c-75f2-41ec-9521-f46cdc14a597 on hv-cinder-85220 Sep 02 21:29:15.743174 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-ba708107-152a-4bd9-9ebf-880c12c9e3bc req-bd80411d-1bd8-4ed4-a1d3-3023e9b06d72 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059430 Sep 02 21:29:15.744401 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 452/862] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:15.984374 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-5dc99f64-df75-438d-952e-c54333765a8c req-93c7c660-a940-4c97-8084-0cf9c2e492f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "febb8d4c-5149-4e92-9363-4e502f0c1a6d", "name": "network-vif-deleted", "tag": "a26f03e8-5797-4109-a4cb-c033343e086e"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:15.995424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-5dc99f64-df75-438d-952e-c54333765a8c req-93c7c660-a940-4c97-8084-0cf9c2e492f3 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:15.995934 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-5dc99f64-df75-438d-952e-c54333765a8c req-93c7c660-a940-4c97-8084-0cf9c2e492f3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:15.996720 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-5dc99f64-df75-438d-952e-c54333765a8c req-93c7c660-a940-4c97-8084-0cf9c2e492f3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.023154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-5dc99f64-df75-438d-952e-c54333765a8c req-93c7c660-a940-4c97-8084-0cf9c2e492f3 service nova] Creating event network-vif-deleted:a26f03e8-5797-4109-a4cb-c033343e086e for instance febb8d4c-5149-4e92-9363-4e502f0c1a6d on hv-cinder-85220 Sep 02 21:29:16.028886 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-5dc99f64-df75-438d-952e-c54333765a8c req-93c7c660-a940-4c97-8084-0cf9c2e492f3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048251 Sep 02 21:29:16.029861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 411/863] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:16.335824 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:16.336649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:16.348189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:16.349687 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:16.351560 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.353427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:16.354504 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:16.355482 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.442002 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:16.452453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ba5a357c-a358-4cd5-a9f2-378084643584 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1512 microversion: 2.1 time: 0.122815 Sep 02 21:29:16.453031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 453/864] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:16 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1512 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:16.730725 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:16.732064 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:16.747144 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:16.748059 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:16.748745 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.749687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:16.750287 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:16.750729 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:16.956572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:16.966604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-23fc584b-4c62-4c46-a8c4-15f6480e3793 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1363 microversion: 2.1 time: 0.243119 Sep 02 21:29:16.970174 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 412/865] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:16 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:17.477499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:17.478447 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:17.484943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:17.485432 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:17.486030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:17.486716 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:17.487095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:17.487495 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:17.528796 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:17.529276 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:17.529741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:17.530222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lazy-loading 'fault' on Instance uuid febb8d4c-5149-4e92-9363-4e502f0c1a6d {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:17.576170 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:17.584208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-709888b6-c727-48b4-b317-54081096c9fe tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1348 microversion: 2.1 time: 0.111333 Sep 02 21:29:17.585428 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 454/866] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:17 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1348 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:17.994597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:17.995225 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:18.004405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.005269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.005950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.007073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.007821 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.008473 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.201561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:18.210400 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-81165e56-3cba-41e9-abae-8b2cee885408 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1548 microversion: 2.1 time: 0.223550 Sep 02 21:29:18.210878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 413/867] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:17 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1548 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:18.236289 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:18.236697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:18.243817 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.244299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.244752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.245486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.245979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.247099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.332525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8bd44dba-0e38-43a2-8d7d-418dff367ba8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100178 Sep 02 21:29:18.333352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 455/868] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Sep 2 21:29:18 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:18.611775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:18.612716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:18.620302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.620802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.621893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.622856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.623319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.623741 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.665305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:18.666616 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:18.667434 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:18.668497 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lazy-loading 'fault' on Instance uuid febb8d4c-5149-4e92-9363-4e502f0c1a6d {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:18.749683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0884441f5744f09b23823752684fe08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a715e1b8137477b9f39b1d6d8d0d268', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:18.758711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4269fb9d-dbbb-4faf-a9d4-99d5ca4a3bf2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 200 len: 1348 microversion: 2.1 time: 0.152119 Sep 02 21:29:18.759307 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 414/869] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:18 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 1348 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:19.623908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-4162336d-510f-4b66-8a28-e351bcd05d03 req-2dd415e8-3c21-4377-bdc3-6aa2b059e4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd", "tag": "cf9887ef-2cab-4e48-ae3a-5e3ed887dcb2"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:19.638215 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-4162336d-510f-4b66-8a28-e351bcd05d03 req-2dd415e8-3c21-4377-bdc3-6aa2b059e4d0 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:19.639020 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-4162336d-510f-4b66-8a28-e351bcd05d03 req-2dd415e8-3c21-4377-bdc3-6aa2b059e4d0 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:19.639458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-4162336d-510f-4b66-8a28-e351bcd05d03 req-2dd415e8-3c21-4377-bdc3-6aa2b059e4d0 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:19.651751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-4162336d-510f-4b66-8a28-e351bcd05d03 req-2dd415e8-3c21-4377-bdc3-6aa2b059e4d0 service nova] Creating event network-changed:cf9887ef-2cab-4e48-ae3a-5e3ed887dcb2 for instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd on hv-cinder-85220 Sep 02 21:29:19.657204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-4162336d-510f-4b66-8a28-e351bcd05d03 req-2dd415e8-3c21-4377-bdc3-6aa2b059e4d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037256 Sep 02 21:29:19.658072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 456/870] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:19.791666 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:19.793186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] [instance: febb8d4c-5149-4e92-9363-4e502f0c1a6d] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:19.805154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:19.805654 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:19.809414 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:19.810586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:19.811385 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:19.812189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:19.832011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] HTTP exception thrown: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d could not be found. Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Request method failure captured: Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d HTTP/1.1 Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnTAANkCm1nWuYtDCWoEvb7P9yJNjJTDIhjHXWXQM_1ij_HCdGHLU3s0GxP9fpeY11fx9eLMvdv1FL5kAfXPO2RJkD6gOAumYzgAC7z7CAts5UnwPmzhy64IoLf-4ubUv4l_C-W-0T-JZUA0SZBu-UnOz0UTXSa9GeNVO7MpodubU4o Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 2a715e1b8137477b9f39b1d6d8d0d268 Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-TestMinimumBasicScenario-151998427 Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:29:19.838687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/2a715e1b8137477b9f39b1d6d8d0d268"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_2a715e1b8137477b9f39b1d6d8d0d268"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a715e1b8137477b9f39b1d6d8d0d268"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/2a715e1b8137477b9f39b1d6d8d0d268"}]}] Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-TestMinimumBasicScenario-151998427 Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 2a715e1b8137477b9f39b1d6d8d0d268 Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-TestMinimumBasicScenario-151998427 Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-TestMinimumBasicScenario-151998427-project Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: b0884441f5744f09b23823752684fe08 Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-TestMinimumBasicScenario-151998427-project Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d could not be found. Sep 02 21:29:19.840556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'febb8d4c-5149-4e92-9363-4e502f0c1a6d'} Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d could not be found. Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:29:19.841602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d could not be found. Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d could not be found. Sep 02 21:29:19.843634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:29:19.848153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Returning 404 to user: Instance febb8d4c-5149-4e92-9363-4e502f0c1a6d could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:29:19.848153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b7077d14-623d-4075-bee0-e6085f47c5c9 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d" status: 404 len: 111 microversion: 2.1 time: 0.060200 Sep 02 21:29:19.854903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 415/871] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:19 2022] GET /compute/v2.1/servers/febb8d4c-5149-4e92-9363-4e502f0c1a6d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:29:19.871831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-16904f3a-8cfc-4a18-949c-ddd0676679b2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] Calling method '.version_select at 0x7fb00cad1280>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:19.981010 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-16904f3a-8cfc-4a18-949c-ddd0676679b2 tempest-TestMinimumBasicScenario-151998427 tempest-TestMinimumBasicScenario-151998427-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1956423974" status: 202 len: 0 microversion: 2.1 time: 0.118059 Sep 02 21:29:19.981766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 457/872] 10.222.0.79 () {58 vars in 1272 bytes} [Fri Sep 2 21:29:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1956423974 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:29:34.012834 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-181739317", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-267356359", "security_groups": [{"name": "tempest-secgroup-smoke-1327319335"}], "networks": [{"uuid": "162fcadc-1048-408f-8503-a2617063fd9d"}], "block_device_mapping_v2": [{"uuid": "0fbb2013-5289-4ca2-8d46-564711e6d0ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:34.024410 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:34.031205 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:34.169993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] validate_networks() for [('162fcadc-1048-408f-8503-a2617063fd9d', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:29:34.588268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:29:34.588688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:29:34.589305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:29:34.589715 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:29:34.590157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:29:34.599633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:34.600357 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:34.600974 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.602500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:34.603206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:34.603818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:34.630705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Getting quotas for project 184566a121dd41218042897eeff2b216. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:29:34.636494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Getting quotas for user 1083cf32e76243ce9a88100374812ab7 and project 184566a121dd41218042897eeff2b216. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:29:34.710327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:29:34.710327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fbb2013-5289-4ca2-8d46-564711e6d0ed',volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:29:35.236764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-eee06097-f6b3-4ef4-98b5-a4b949873b5a tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.227356 Sep 02 21:29:35.237782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 416/873] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:29:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:29:35.249208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-185c7447-ca58-4e41-a4af-1f5af7bf7b2d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:35.250614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-185c7447-ca58-4e41-a4af-1f5af7bf7b2d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:35.254989 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=34 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:35.259028 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:35.331048 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-185c7447-ca58-4e41-a4af-1f5af7bf7b2d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:35.342630 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-185c7447-ca58-4e41-a4af-1f5af7bf7b2d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1087 microversion: 2.1 time: 0.095965 Sep 02 21:29:35.343638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 458/874] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:35 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1087 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:36.369742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-521e01d3-85ae-4602-a158-0ad785ebbe43 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:36.371145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-521e01d3-85ae-4602-a158-0ad785ebbe43 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:36.433901 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-521e01d3-85ae-4602-a158-0ad785ebbe43 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:36.441393 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-521e01d3-85ae-4602-a158-0ad785ebbe43 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1087 microversion: 2.1 time: 0.076269 Sep 02 21:29:36.442017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 417/875] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:36 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1087 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:37.465741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:37.466390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:37.474955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:37.475556 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:37.475989 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:37.476949 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:37.477210 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:37.478791 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:37.562580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:37.571443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c001d0a3-8fd4-4387-9da7-11ad000b0713 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1185 microversion: 2.1 time: 0.110162 Sep 02 21:29:37.572025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 459/876] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:37 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:38.597703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:38.598344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:38.606531 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.607526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.607785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.608500 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:38.608954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:38.609591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:38.688267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:38.698210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f2991b25-3d24-43fc-a628-437e23aece54 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1193 microversion: 2.1 time: 0.105196 Sep 02 21:29:38.698980 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 418/877] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:38 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1193 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:39.742974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:39.742974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:39.742974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:39.742974 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:39.743651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:39.743651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:39.743651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:39.743651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:39.898017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:39.906984 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1805007c-72e0-4725-aed7-77eae32265ee tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1271 microversion: 2.1 time: 0.187991 Sep 02 21:29:39.907786 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 460/878] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:39 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:40.575312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-3543f80e-c413-4dbd-ba7e-390b2f996107 req-1126a219-cba0-485c-8bf1-935e593b2a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9", "tag": "73eb3820-b2cc-485f-973f-ce9f5381c072"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:40.586972 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-3543f80e-c413-4dbd-ba7e-390b2f996107 req-1126a219-cba0-485c-8bf1-935e593b2a67 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:40.587461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-3543f80e-c413-4dbd-ba7e-390b2f996107 req-1126a219-cba0-485c-8bf1-935e593b2a67 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:40.587896 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-3543f80e-c413-4dbd-ba7e-390b2f996107 req-1126a219-cba0-485c-8bf1-935e593b2a67 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:40.614201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-3543f80e-c413-4dbd-ba7e-390b2f996107 req-1126a219-cba0-485c-8bf1-935e593b2a67 service nova] Creating event network-changed:73eb3820-b2cc-485f-973f-ce9f5381c072 for instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 on hv-cinder-85220 Sep 02 21:29:40.622623 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-3543f80e-c413-4dbd-ba7e-390b2f996107 req-1126a219-cba0-485c-8bf1-935e593b2a67 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051431 Sep 02 21:29:40.623242 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 419/879] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:40.932071 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:40.932832 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:40.939750 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:40.940257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:40.940704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:40.941422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:40.941914 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:40.942348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:41.091807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:41.100981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3b839037-d791-4dc2-9432-6feb84b9eef8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.173137 Sep 02 21:29:41.101682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 461/880] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:40 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:42.127187 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:42.128564 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:42.136956 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:42.137547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:42.138387 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:42.139430 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:42.140527 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:42.140527 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:42.285697 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:42.295557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-85b2349f-3f2f-4255-affd-d008ca93de82 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.174008 Sep 02 21:29:42.296165 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 420/881] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:42 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:43.324631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:43.325226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:43.332349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.333260 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.333379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.334206 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:43.334687 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:43.335106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:43.484060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:43.492169 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a40e0d39-4d70-4352-959c-95f59b623367 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.172431 Sep 02 21:29:43.492749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 462/882] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:43 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:44.515446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:44.516044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:44.522811 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.523303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.523745 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.524445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:44.524904 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:44.525333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:44.614707 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:44.667325 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:44.676012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b3aa2685-63c2-437c-81af-4447c3633b9e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.164411 Sep 02 21:29:44.676603 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 421/883] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:44 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:45.699733 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:45.700348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:45.702325 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:45.707388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.707878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.708316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.709035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:45.709541 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:45.709991 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:45.857642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:45.865867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2c9e7efb-391b-491d-afbe-31a49d2c1574 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.170139 Sep 02 21:29:45.866422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 463/884] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:45 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:46.891184 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:46.891719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:46.894137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=8 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:29:46.899014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:46.899503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:46.899941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:46.900662 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:46.901130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:46.913315 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:47.044505 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:47.052638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-08ff1d9f-eeac-4a10-a2a0-24f39b86eac2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.165561 Sep 02 21:29:47.053213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 422/885] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:46 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:48.076596 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:48.077150 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:48.084261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:48.084745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:48.085182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:48.085924 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:48.086445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:48.086881 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:48.238314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:48.246525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-62701f3b-2796-4a97-ba49-d69cc3597d8b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.173908 Sep 02 21:29:48.247116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 464/886] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:48 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:49.270113 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:49.270719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:49.277461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:49.277983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:49.278536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:49.279127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:49.279579 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:49.280004 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:49.431679 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:49.439798 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5f4a2f76-e1e6-4b60-a166-afa028e248f8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.173486 Sep 02 21:29:49.440399 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 423/887] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:49 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:50.466727 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:50.467801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:50.479846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:50.481528 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:50.481528 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:50.482838 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:50.483795 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:50.484721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:50.645235 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:50.653944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2b61bf00-4307-4d30-9b33-395b55598a6f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.193801 Sep 02 21:29:50.654544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 465/888] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:50 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:51.679232 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:51.680124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:51.689723 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:51.690547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:51.691166 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:51.692119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:51.692817 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:51.693364 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:51.855643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:51.867637 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c11f8f78-be71-48f2-894b-d78468f1c580 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.194385 Sep 02 21:29:51.868218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 424/889] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:51 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:52.908237 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:52.909964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:52.915524 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:52.936293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:52.936293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:52.936293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:52.936293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:52.936781 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:53.080457 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:53.089661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0f7f53d9-04a2-4443-808e-3fccc7606553 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.185350 Sep 02 21:29:53.093063 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 466/890] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:52 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:53.093245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-edf9e269-4532-4876-b587-24230d679465 req-16a58509-9e53-4725-a0a7-ad7d28cdbe85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9", "name": "network-vif-plugged", "status": "completed", "tag": "73eb3820-b2cc-485f-973f-ce9f5381c072"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:53.106855 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-edf9e269-4532-4876-b587-24230d679465 req-16a58509-9e53-4725-a0a7-ad7d28cdbe85 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:53.107358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-edf9e269-4532-4876-b587-24230d679465 req-16a58509-9e53-4725-a0a7-ad7d28cdbe85 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:53.107788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-edf9e269-4532-4876-b587-24230d679465 req-16a58509-9e53-4725-a0a7-ad7d28cdbe85 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:53.120485 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-edf9e269-4532-4876-b587-24230d679465 req-16a58509-9e53-4725-a0a7-ad7d28cdbe85 service nova] Creating event network-vif-plugged:73eb3820-b2cc-485f-973f-ce9f5381c072 for instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 on hv-cinder-85220 Sep 02 21:29:53.126223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-edf9e269-4532-4876-b587-24230d679465 req-16a58509-9e53-4725-a0a7-ad7d28cdbe85 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039336 Sep 02 21:29:53.127288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 425/891] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:29:54.113956 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:54.114516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:54.121386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:54.121910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:54.122352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:54.123062 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:54.123517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:54.123944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:54.276886 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:54.285382 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1a417a7c-5bd4-42df-87b7-387e628a95ed tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.175344 Sep 02 21:29:54.285995 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 467/892] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:54 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:55.309378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:55.310102 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:55.317152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:55.317635 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:55.318106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:55.318806 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:55.319264 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:55.319679 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:55.468967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:55.476993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-59991ca4-640f-4f01-8fc8-413c7129402c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1259 microversion: 2.1 time: 0.171854 Sep 02 21:29:55.477517 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 426/893] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:55 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:56.502129 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:56.502763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:56.510172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:56.510760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:56.511196 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:56.511947 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:56.512369 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:56.512810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:56.628873 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:56.629510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:56.637169 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:56.637661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:56.638147 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:56.638929 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:56.639386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:56.639810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:56.651584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:56.659920 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-01409668-ec1a-49a7-a15b-9e01b7410ca5 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1443 microversion: 2.1 time: 0.161955 Sep 02 21:29:56.660489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 468/894] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:56 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:56.669529 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:29:56.692057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:56.696384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:56.700149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:56.700672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:56.701105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:56.701840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:56.702325 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:56.702759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:56.863057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:56.874213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-11f5b4f5-6315-45ca-82e8-241166bd78fd tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1443 microversion: 2.1 time: 0.191313 Sep 02 21:29:56.875347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 469/895] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:56 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1443 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:29:56.980174 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c469288b-f6c3-448e-957d-9474f4ad71b3 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "DELETE /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 204 len: 0 microversion: 2.1 time: 0.355112 Sep 02 21:29:56.980890 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 427/896] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:29:56 2022] DELETE /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 21:29:56.995627 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:56.996683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:57.006943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:57.007912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:57.008638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:57.010162 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:57.010863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:57.011665 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:57.176750 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:57.179912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d32bc7e2-c214-4dbf-9628-e51863300f15 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1576 microversion: 2.1 time: 0.192436 Sep 02 21:29:57.180505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 470/897] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:56 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:58.213163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:58.214343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:58.222140 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:58.223021 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:58.223494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:58.224223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:58.224689 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:58.225205 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:58.377561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:58.385301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c2a798d0-deca-49a5-959b-155a723cc344 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1576 microversion: 2.1 time: 0.182241 Sep 02 21:29:58.386017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 428/898] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:58 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:29:58.963456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:58.964063 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:58.973567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:58.974577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:58.975357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:58.976670 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:58.977514 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:58.979282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:59.093752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lazy-loading 'services' on Instance uuid 06870d3d-d4b2-4493-b4a9-c6e33f1824be {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:29:59.287707 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fcac77d6-076c-4847-8a8f-b4783b2a47c0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "DELETE /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments/b647289f-7a8b-4e5e-8645-409ee2ffd976" status: 202 len: 0 microversion: 2.1 time: 0.329030 Sep 02 21:29:59.288384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 471/899] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:29:58 2022] DELETE /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments/b647289f-7a8b-4e5e-8645-409ee2ffd976 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:29:59.298671 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:59.300976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:59.309514 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:59.310047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:59.310493 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:59.311215 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:59.311667 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:59.312142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:59.351947 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-377bf4f5-2e80-4585-baeb-6516f4708332 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056014 Sep 02 21:29:59.351947 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 429/900] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:29:59 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:59.410777 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:29:59.411931 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:29:59.419116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:59.419715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:59.420219 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:59.421022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:59.421715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:59.422449 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:59.449386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-29bd967f-91d6-4cb6-8346-65acf7526aee req-21648615-a680-4a60-ba1f-2e10c592098c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9", "tag": "73eb3820-b2cc-485f-973f-ce9f5381c072"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:29:59.460136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-29bd967f-91d6-4cb6-8346-65acf7526aee req-21648615-a680-4a60-ba1f-2e10c592098c service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:29:59.460764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-29bd967f-91d6-4cb6-8346-65acf7526aee req-21648615-a680-4a60-ba1f-2e10c592098c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:29:59.461205 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-29bd967f-91d6-4cb6-8346-65acf7526aee req-21648615-a680-4a60-ba1f-2e10c592098c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:29:59.474016 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-29bd967f-91d6-4cb6-8346-65acf7526aee req-21648615-a680-4a60-ba1f-2e10c592098c service nova] Creating event network-changed:73eb3820-b2cc-485f-973f-ce9f5381c072 for instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 on hv-cinder-85220 Sep 02 21:29:59.480185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-29bd967f-91d6-4cb6-8346-65acf7526aee req-21648615-a680-4a60-ba1f-2e10c592098c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035395 Sep 02 21:29:59.480973 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 430/901] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:29:59.579663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:29:59.591414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0c1b2011-6f97-4bc7-93c4-ea560ec31517 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1576 microversion: 2.1 time: 0.185457 Sep 02 21:29:59.592614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 472/902] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:29:59 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:00.372371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:00.377112 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:00.384128 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:00.385236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:00.385787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:00.386646 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:00.387549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:00.387923 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:00.433419 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-da2f48ff-8ab1-450b-849f-6038b4688be3 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070936 Sep 02 21:30:00.434111 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 431/903] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:30:00 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:00.864817 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:00.866945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:00.878286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:00.879189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:00.880052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:00.881061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:00.881611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:00.882169 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:00.958085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:00.970216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d8dfc2df-9ff6-4cd3-abb0-2a4b6af47ec1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1509 microversion: 2.1 time: 0.351941 Sep 02 21:30:00.971158 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 473/904] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:00 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1509 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:01.447514 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:01.450632 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:01.460379 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:01.461282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:01.462237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:01.463458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:01.464283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:01.465693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:01.502772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b3e6ccf0-cc2e-4bf7-8569-4d470f0049b7 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060216 Sep 02 21:30:01.504058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-fc520ac5-b095-45b2-a40d-2fb506b01f38 req-ad0f426e-503a-4e2b-8b63-8de29b91e433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "388a2bcc-b930-4062-9ab7-e611f34dc102", "name": "network-vif-deleted", "tag": "648c20bd-32e2-430a-a5cb-c0a728e71c74"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:01.509587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 432/905] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:30:01 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:30:01.519232 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-fc520ac5-b095-45b2-a40d-2fb506b01f38 req-ad0f426e-503a-4e2b-8b63-8de29b91e433 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:01.519635 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-fc520ac5-b095-45b2-a40d-2fb506b01f38 req-ad0f426e-503a-4e2b-8b63-8de29b91e433 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:01.520664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-fc520ac5-b095-45b2-a40d-2fb506b01f38 req-ad0f426e-503a-4e2b-8b63-8de29b91e433 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:01.537877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-fc520ac5-b095-45b2-a40d-2fb506b01f38 req-ad0f426e-503a-4e2b-8b63-8de29b91e433 service nova] Creating event network-vif-deleted:648c20bd-32e2-430a-a5cb-c0a728e71c74 for instance 388a2bcc-b930-4062-9ab7-e611f34dc102 on hv-cinder-85220 Sep 02 21:30:01.546017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-fc520ac5-b095-45b2-a40d-2fb506b01f38 req-ad0f426e-503a-4e2b-8b63-8de29b91e433 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046662 Sep 02 21:30:01.546820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 474/906] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:01.638417 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:01.638837 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:01.645143 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:01.645613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:01.646086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:01.646791 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:01.647247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:01.647677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:01.678432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:30:01.718776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:02.001321 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:02.002486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:02.014039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:02.014909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:02.015695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:02.016904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:02.017721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:02.018539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:02.045320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:02.110279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:02.119294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b1117638-4517-4eeb-9eec-334f1a6d2c2e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1224 microversion: 2.1 time: 0.125994 Sep 02 21:30:02.134872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 475/907] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:01 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:02.203929 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a738ebc3-a482-466f-934d-614b0d0aa85e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "DELETE /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 204 len: 0 microversion: 2.1 time: 0.569159 Sep 02 21:30:02.204805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 433/908] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:30:01 2022] DELETE /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:30:02.219478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:02.220249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:02.229604 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:02.230445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:02.231025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:02.231884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:02.232459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:02.233003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:02.427039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:02.442010 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ea9a9b83-4758-4923-9b19-f6b3bce13f1f tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1691 microversion: 2.1 time: 0.230892 Sep 02 21:30:02.443029 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 476/909] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:02 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1691 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:03.145137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:03.145746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:03.154179 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:03.154700 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:03.155153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:03.155872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:03.156341 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:03.156805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:03.191513 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:03.191996 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:03.192437 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:03.192885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lazy-loading 'fault' on Instance uuid 388a2bcc-b930-4062-9ab7-e611f34dc102 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:03.236382 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:03.246785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-643b47c2-bd6f-4f6c-beb3-7da5a0d7772a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1229 microversion: 2.1 time: 0.105852 Sep 02 21:30:03.247375 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 434/910] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:03 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:03.479034 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:03.479743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:03.486539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:03.487083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:03.487579 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:03.488282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:03.488742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:03.489165 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:03.635058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:03.644083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-448176ea-9cff-463f-812a-a76872307382 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1691 microversion: 2.1 time: 0.169003 Sep 02 21:30:03.644670 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 477/911] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:03 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:04.273640 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:04.278557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:04.282116 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:04.282615 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:04.283061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:04.283784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:04.284295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:04.284776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:04.321194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:04.321768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:04.322522 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:04.322979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lazy-loading 'fault' on Instance uuid 388a2bcc-b930-4062-9ab7-e611f34dc102 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:04.368878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:04.377888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a5f6b6e9-80dd-4345-a273-71f936e227e2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1229 microversion: 2.1 time: 0.109409 Sep 02 21:30:04.378480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 435/912] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:04 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1229 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:04.671276 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:04.671898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:04.680191 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:04.680772 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:04.681972 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:04.682751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:04.683359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:04.683725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:04.840695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:04.848851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-25afb448-834d-41b7-b55c-df83035256e8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1691 microversion: 2.1 time: 0.181997 Sep 02 21:30:04.849424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 478/913] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:04 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:05.403661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:05.404563 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:05.407048 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:05.411868 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:05.412355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:05.418435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:05.418435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:05.418435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:05.418435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:05.451306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:05.451880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:05.452321 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:05.452775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lazy-loading 'fault' on Instance uuid 388a2bcc-b930-4062-9ab7-e611f34dc102 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:05.498584 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:05.507145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-878ce8b4-ba1b-409c-90ed-1c2372a6f280 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1229 microversion: 2.1 time: 0.108710 Sep 02 21:30:05.507737 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 436/914] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:05 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:05.875361 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:05.876125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:05.882720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:05.883208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:05.883641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:05.885245 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:05.885717 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:05.886177 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:06.033422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:06.044478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9edc27c0-29fa-409b-bea0-a176f44d3fe0 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1691 microversion: 2.1 time: 0.173200 Sep 02 21:30:06.045060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 479/915] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:05 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:06.531337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:06.531949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:06.538927 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:06.539410 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:06.539847 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:06.540964 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:06.541421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:06.541859 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:06.577791 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:06.578321 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:06.578753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:06.579199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lazy-loading 'fault' on Instance uuid 388a2bcc-b930-4062-9ab7-e611f34dc102 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:06.623036 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:06.635587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b4364283-df84-4a75-a9f6-50c64e212a30 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1229 microversion: 2.1 time: 0.108235 Sep 02 21:30:06.635587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 437/916] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:06 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:07.085018 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:07.085669 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:07.093355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:07.093876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:07.094401 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:07.095110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:07.095561 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:07.096017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:07.252182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:07.261774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1b59f75f-e2b3-4d5d-ba5e-fe78578e5b4e tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1691 microversion: 2.1 time: 0.180735 Sep 02 21:30:07.262411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 480/917] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:07 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1691 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:07.660572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:07.661188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:07.668991 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:07.669479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:07.669950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:07.670686 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:07.671137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:07.671598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:07.712951 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:07.713501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:07.713979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:07.714438 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lazy-loading 'fault' on Instance uuid 388a2bcc-b930-4062-9ab7-e611f34dc102 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:07.772957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:07.782949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-eb0015d2-b4f5-494f-b9b6-cf98dd129a46 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1229 microversion: 2.1 time: 0.127068 Sep 02 21:30:07.783580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 438/918] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:07 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:08.288061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:08.288670 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:08.291697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=49 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:08.297353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:08.297549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:08.298132 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:08.304030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:08.304030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:08.304030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:08.467074 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:08.475734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c38c689d-21af-4501-bba5-da217d04f402 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1691 microversion: 2.1 time: 0.191564 Sep 02 21:30:08.486001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 481/919] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:08 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1691 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:08.808104 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:08.812910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:08.815564 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:08.816052 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:08.816574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:08.817277 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:08.817736 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:08.818198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:08.852206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:08.853233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:08.853680 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:08.854281 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lazy-loading 'fault' on Instance uuid 388a2bcc-b930-4062-9ab7-e611f34dc102 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:08.900616 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:08.910375 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2329d713-1ee2-46f4-a4d3-502f639e2b36 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 200 len: 1229 microversion: 2.1 time: 0.107386 Sep 02 21:30:08.911210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 439/920] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:08 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:08.981716 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-272e9e9d-86a8-423c-bf5e-30d0ae14c9e4 req-df8b0121-913b-4fa3-adc8-9f9a62a8e850 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06870d3d-d4b2-4493-b4a9-c6e33f1824be", "name": "network-vif-deleted", "tag": "737355df-9df5-464b-b327-d997ff9abc7a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:08.995959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-272e9e9d-86a8-423c-bf5e-30d0ae14c9e4 req-df8b0121-913b-4fa3-adc8-9f9a62a8e850 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:08.996663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-272e9e9d-86a8-423c-bf5e-30d0ae14c9e4 req-df8b0121-913b-4fa3-adc8-9f9a62a8e850 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:08.998044 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-272e9e9d-86a8-423c-bf5e-30d0ae14c9e4 req-df8b0121-913b-4fa3-adc8-9f9a62a8e850 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:09.012099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-272e9e9d-86a8-423c-bf5e-30d0ae14c9e4 req-df8b0121-913b-4fa3-adc8-9f9a62a8e850 service nova] Creating event network-vif-deleted:737355df-9df5-464b-b327-d997ff9abc7a for instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be on hv-cinder-85220 Sep 02 21:30:09.018085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-272e9e9d-86a8-423c-bf5e-30d0ae14c9e4 req-df8b0121-913b-4fa3-adc8-9f9a62a8e850 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040797 Sep 02 21:30:09.019308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 482/921] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:09.503049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:09.503702 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:09.510844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:09.511355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:09.511782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:09.512498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:09.512950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:09.513464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:09.550950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:09.551701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:09.552142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:09.552597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lazy-loading 'fault' on Instance uuid 06870d3d-d4b2-4493-b4a9-c6e33f1824be {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:09.606580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:09.614881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3e266d87-c60d-4329-b0f5-ccb967448393 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1336 microversion: 2.1 time: 0.116169 Sep 02 21:30:09.615526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 440/922] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:09 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:09.937555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:09.938427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:09.945047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:09.945568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:09.946713 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:09.947527 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:09.947993 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:09.948423 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:09.965597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] HTTP exception thrown: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Request method failure captured: Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 HTTP/1.1 Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnSea43Qxa8TH4GEWgsT96CNditwYodKMydT-Ma_7airb3DJK3KavKHm15z2YaHMLApwAzrOvQxttuASxbCTP8mYQM_9VAvUtlpbxvXeFdCwQH7TUMKmycN0yNz3ILt20BEy8Gb__hpDmmf1tk_Iqw2nB3cOSd2U_csP22vjRD27Rjg Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:30:09.967330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}] Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-TestVolumeBootPattern-133567657 Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e2940758d8424054bf3a68a42b79bb81 Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:30:09.968930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '388a2bcc-b930-4062-9ab7-e611f34dc102'} Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:30:09.969867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:30:09.971214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:09.972581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Returning 404 to user: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:30:09.972581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f6031cb8-0bae-40a2-9c81-f5072a381bf0 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 404 len: 111 microversion: 2.1 time: 0.036285 Sep 02 21:30:09.972581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 483/923] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:09 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:10.082033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-210056589", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-261479926", "security_groups": [{"name": "tempest-secgroup-smoke-203437446"}], "block_device_mapping_v2": [{"uuid": "555f9127-9ece-4577-ba4e-33206ad78c78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "114c3cb0-28e2-4cd4-ac62-ba9797320ab1"}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:10.217342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] validate_networks() for [('114c3cb0-28e2-4cd4-ac62-ba9797320ab1', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:30:10.639368 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:10.640253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:10.647150 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:10.647447 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:10.648122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:10.648867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:10.649508 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:10.649998 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:10.674426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:30:10.674426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:30:10.674426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:30:10.674426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:30:10.674426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:30:10.699359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:10.702106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:10.703088 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:10.704209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:10.704703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:10.705331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:10.712657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:10.713413 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:10.714056 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:10.714763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lazy-loading 'fault' on Instance uuid 06870d3d-d4b2-4493-b4a9-c6e33f1824be {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:10.735387 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Getting quotas for project d0d9b4769b124ec69714a30d02bb8557. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:30:10.744578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Getting quotas for user e2940758d8424054bf3a68a42b79bb81 and project d0d9b4769b124ec69714a30d02bb8557. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:30:10.764964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:10.778927 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-74586378-10d7-4e4e-84dd-6a6461631149 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 200 len: 1336 microversion: 2.1 time: 0.143382 Sep 02 21:30:10.779518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 484/924] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:10 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 1336 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:10.818614 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:30:10.820815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='555f9127-9ece-4577-ba4e-33206ad78c78',volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:30:11.239250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5bb022bb-4a40-479d-853e-cebb9c84100c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.161374 Sep 02 21:30:11.240097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 441/925] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:30:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:30:11.253005 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d6b7d88e-7acd-4647-8450-439afcf2fa0d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:11.253772 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d6b7d88e-7acd-4647-8450-439afcf2fa0d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:11.311878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d6b7d88e-7acd-4647-8450-439afcf2fa0d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:11.323684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d6b7d88e-7acd-4647-8450-439afcf2fa0d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1093 microversion: 2.1 time: 0.074831 Sep 02 21:30:11.326271 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:11.326984 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:11.335071 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:11.335935 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:11.336258 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:11.337758 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:11.338248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:11.338408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 485/926] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:11 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:11.338739 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:11.368993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-285c276b-3914-4440-8d00-ba2aef803e58 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/ips" status: 200 len: 152 microversion: 2.20 time: 0.049416 Sep 02 21:30:11.369583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 442/927] 10.222.0.79 () {60 vars in 1289 bytes} [Fri Sep 2 21:30:11 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/ips => generated 152 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 21:30:11.803838 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:11.804454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 06870d3d-d4b2-4493-b4a9-c6e33f1824be] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:11.811543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:11.812074 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:11.812510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:11.813213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:11.813697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:11.814159 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:11.830340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] HTTP exception thrown: Instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be could not be found. Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Request method failure captured: Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be HTTP/1.1 Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQuA7tr86m4arxlUyz1sKUAwEHai_4Lbj-lbjLGsK0D8VwzMO5HYHfVyme-dtN2n9o9oDWjrb8bC4VcXT_A5AIzkitlo1KlXTYvF5IhqjNxpa-cx0MrRsLQ7OafI1s5xNuMBjK0TqgGEyiJR7OUFvdDhk0a1rWWQCmaEcIS6F4kp-I Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:30:11.831977 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}] Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: c81bafbe3e444e84a7da18ac9d782479 Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be could not be found. Sep 02 21:30:11.833695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '06870d3d-d4b2-4493-b4a9-c6e33f1824be'} Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be could not be found. Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:30:11.834641 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be could not be found. Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be could not be found. Sep 02 21:30:11.836079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:11.838081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Returning 404 to user: Instance 06870d3d-d4b2-4493-b4a9-c6e33f1824be could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:30:11.838081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ddbf20dd-73f3-418f-96ce-7f99caebe4f2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be" status: 404 len: 111 microversion: 2.1 time: 0.033471 Sep 02 21:30:11.838081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 486/928] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:11 2022] GET /compute/v2.1/servers/06870d3d-d4b2-4493-b4a9-c6e33f1824be => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:11.842969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c6f0dd16-45c9-42e5-8a4e-6b1f215ab490 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '.version_select at 0x7fb00cb075e0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:11.997686 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c6f0dd16-45c9-42e5-8a4e-6b1f215ab490 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730082136" status: 202 len: 0 microversion: 2.1 time: 0.158662 Sep 02 21:30:11.998314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 443/929] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Sep 2 21:30:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730082136 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:30:12.350988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:12.351779 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:12.359485 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:12.359996 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:12.360513 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:12.361240 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:12.361711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:12.362190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:12.452104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:12.463234 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ec55ab43-d079-4dd1-9421-9261a653755a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1143 microversion: 2.1 time: 0.116565 Sep 02 21:30:12.465464 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 487/930] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:12 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1143 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:13.490881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:13.491894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:13.500204 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:13.500753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:13.501240 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:13.502510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:13.502510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:13.502965 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:13.601284 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:13.611027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-107d69a6-9243-4b03-81c6-e863f8913a63 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1191 microversion: 2.1 time: 0.126856 Sep 02 21:30:13.611887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 444/931] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:13 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1191 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:14.304493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:14.306143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:14.316719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:14.317707 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:14.318239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:14.319088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:14.319687 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:14.320125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:14.350823 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lazy-loading 'flavor' on Instance uuid 7327938c-75f2-41ec-9521-f46cdc14a597 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:14.640691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:14.642440 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:14.652707 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:14.653235 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:14.654068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:14.654480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:14.655240 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:14.663781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:14.765570 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:14.768507 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-60fa1b27-24c1-484b-8eaf-6efddd705135 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1199 microversion: 2.1 time: 0.135275 Sep 02 21:30:14.769026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 445/932] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:14 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1199 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:15.042278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-590319ac-cf07-4d5c-bbe9-5abf7ee77f1f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/action" status: 202 len: 0 microversion: 2.20 time: 0.743805 Sep 02 21:30:15.043331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 488/933] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Sep 2 21:30:14 2022] POST /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/action => generated 0 bytes in 746 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:30:15.062840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:15.063997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:15.075394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:15.076396 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:15.077067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:15.078053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:15.078728 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:15.079315 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:15.264906 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:15.274225 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:15.275691 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:15.276884 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e5fb84e6-33f0-4753-bb89-c86199fb1af8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.225162 Sep 02 21:30:15.277436 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 446/934] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:15 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:15.351303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:15.352827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:15.362706 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:15.363207 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:15.363648 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:15.364390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:15.364869 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:15.365302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:15.411227 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b134cffe-b9fe-4633-b1f0-7a967fb31c62 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/ips" status: 200 len: 145 microversion: 2.1 time: 0.065406 Sep 02 21:30:15.412369 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 489/935] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:30:15 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/ips => generated 145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:15.797484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:15.800314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:15.808951 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:15.809511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:15.809987 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:15.811076 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:15.811548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:15.811981 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:16.005678 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:16.024392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4b96b9aa-e718-45ec-a293-6a4431436c0a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1276 microversion: 2.1 time: 0.232920 Sep 02 21:30:16.030238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 447/936] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:15 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:16.295876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:16.296864 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:16.304412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:16.306403 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:16.324130 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:16.328059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:16.328953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:16.329548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:16.330253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:16.331198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:16.331736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:16.332304 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:16.333153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:16.333687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:16.334343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:16.340565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:16.422957 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:30:16.593984 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:16.604018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:16.605945 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:16.607634 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-626460c7-04e8-4dca-8133-2c0da901d082 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.308580 Sep 02 21:30:16.630112 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 448/937] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:16 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:17.028001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-72800808-f292-4812-8da8-f6a440e3430c tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "DELETE /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 204 len: 0 microversion: 2.1 time: 0.738281 Sep 02 21:30:17.028727 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 490/938] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:30:16 2022] DELETE /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:30:17.038205 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:17.038976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:17.046909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.047683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.048512 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.049579 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.050231 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.051096 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.068587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:17.069390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:17.083913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.084157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:17.084450 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.084450 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.084450 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.084450 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.084837 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.110134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:17.273681 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:17.294057 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d789277c-2a19-413b-9017-fd0aacdf3709 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1508 microversion: 2.1 time: 0.259633 Sep 02 21:30:17.296408 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 449/939] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:17 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1508 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:17.299612 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:17.309030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e6a37602-c35e-4d57-a5e1-e5e4df4d127c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1276 microversion: 2.1 time: 0.255859 Sep 02 21:30:17.309969 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 491/940] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:17 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1276 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:17.332739 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-d3a6e31d-488f-485f-a44d-d848973564a1 req-c1adddbe-fecd-4a4b-b6db-9f8dd714a5ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86f6c53-b430-449d-9788-8b80d3c3b540", "tag": "14b2721f-8d73-4e00-955d-00d02b29a184"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:17.349918 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d3a6e31d-488f-485f-a44d-d848973564a1 req-c1adddbe-fecd-4a4b-b6db-9f8dd714a5ba service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.350665 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d3a6e31d-488f-485f-a44d-d848973564a1 req-c1adddbe-fecd-4a4b-b6db-9f8dd714a5ba service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.351306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d3a6e31d-488f-485f-a44d-d848973564a1 req-c1adddbe-fecd-4a4b-b6db-9f8dd714a5ba service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.364697 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-d3a6e31d-488f-485f-a44d-d848973564a1 req-c1adddbe-fecd-4a4b-b6db-9f8dd714a5ba service nova] Creating event network-changed:14b2721f-8d73-4e00-955d-00d02b29a184 for instance c86f6c53-b430-449d-9788-8b80d3c3b540 on hv-cinder-85220 Sep 02 21:30:17.370568 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-d3a6e31d-488f-485f-a44d-d848973564a1 req-c1adddbe-fecd-4a4b-b6db-9f8dd714a5ba service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072047 Sep 02 21:30:17.371192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 450/941] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:17.446022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd733bdb-aacd-41d2-abc8-43e8b9fe87ed"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:17.449153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:17.456458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.457040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.457400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.458127 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.458579 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.459175 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.638325 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:17.639388 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:17.646933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.659790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.659790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.659790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:17.659790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:17.660245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:17.814231 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:17.824368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:17.825998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:17.827346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9f642e19-6eae-4c42-862d-2b6bb287a06e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.194103 Sep 02 21:30:17.835282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 451/942] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:17 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:18.333569 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:18.334602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:18.343848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:18.344702 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:18.345263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.346318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:18.347239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:18.347640 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.523158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:18.541682 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a264589b-f69a-4455-8329-89f9a96ff4f8 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1508 microversion: 2.1 time: 0.212761 Sep 02 21:30:18.542440 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 452/943] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:18 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:18.556722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:18.557587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:18.567147 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:18.567898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:18.568383 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.569178 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:18.569619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:18.570123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.736342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:18.750423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9f2fa3f7-c74b-4a59-82c5-f1ad71ada172 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.206079 Sep 02 21:30:18.753876 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 453/944] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:18 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:18.859487 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:18.860482 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:18.871194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:18.871935 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:18.872596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.873995 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:18.874701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:18.875358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:18.914813 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6428cbe9-36c2-47da-a44f-63d3becb40cd tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.471756 Sep 02 21:30:18.922636 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 492/945] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:30:17 2022] POST /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments => generated 194 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:19.138460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:19.147764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:19.149456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:19.150885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-842e0a95-fa98-4420-a3ee-037f621b192f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.300800 Sep 02 21:30:19.159538 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 454/946] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:18 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:19.393785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-8db1eaac-7fde-4a9d-8041-1859f4763a4a req-89f89813-8cfe-4d55-a1b7-d857a26aef0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8b3ea43-6b55-4349-8138-5503976ddeb2", "name": "network-vif-deleted", "tag": "020c4c59-47d4-4b7e-8344-93353874fe13"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:19.413863 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-8db1eaac-7fde-4a9d-8041-1859f4763a4a req-89f89813-8cfe-4d55-a1b7-d857a26aef0c service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:19.415444 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-8db1eaac-7fde-4a9d-8041-1859f4763a4a req-89f89813-8cfe-4d55-a1b7-d857a26aef0c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:19.416014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-8db1eaac-7fde-4a9d-8041-1859f4763a4a req-89f89813-8cfe-4d55-a1b7-d857a26aef0c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:19.431986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-8db1eaac-7fde-4a9d-8041-1859f4763a4a req-89f89813-8cfe-4d55-a1b7-d857a26aef0c service nova] Creating event network-vif-deleted:020c4c59-47d4-4b7e-8344-93353874fe13 for instance f8b3ea43-6b55-4349-8138-5503976ddeb2 on hv-cinder-85220 Sep 02 21:30:19.437579 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-8db1eaac-7fde-4a9d-8041-1859f4763a4a req-89f89813-8cfe-4d55-a1b7-d857a26aef0c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053217 Sep 02 21:30:19.438325 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 493/947] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:19.565528 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:19.566154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:19.573828 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:19.574328 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:19.574798 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:19.575565 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:19.576015 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:19.576440 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:19.645334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:19.666142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fc0b15be-9fda-462c-95a8-133b991fbad2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1293 microversion: 2.1 time: 0.104355 Sep 02 21:30:19.666733 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 455/948] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:19 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:19.791945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:19.792795 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:19.799197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:19.799689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:19.800130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:19.800831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:19.803728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:19.803728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:19.948699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:19.957423 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a95ee8e7-1bf1-4708-95b4-ff5612bbeaa5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.170123 Sep 02 21:30:19.958030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 494/949] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:19 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:20.177032 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:20.177728 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:20.184904 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.185664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.186436 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:20.187205 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.187660 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.188269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:20.336984 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:20.345394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:20.347020 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:20.348263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7b744922-7bb1-4a33-8988-2afc94886576 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.174999 Sep 02 21:30:20.348990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 456/950] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:20 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:20.690827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:20.691972 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:20.708000 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.708505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.709407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:20.709632 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.710146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.710567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:20.746528 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.747019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.747486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:20.747924 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lazy-loading 'fault' on Instance uuid f8b3ea43-6b55-4349-8138-5503976ddeb2 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:20.791708 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:20.799930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e844d0f1-7d2c-4833-9635-8df5b9eb11d2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 200 len: 1312 microversion: 2.1 time: 0.113251 Sep 02 21:30:20.800517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 495/951] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:20 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 1312 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:20.981604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:20.982231 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:20.984961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:20.985881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:20.992158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.992651 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.993089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:20.993995 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:20.994519 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:20.994953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.138734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:21.147669 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2e1831af-29c9-424c-8620-b9c9c390903e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.170735 Sep 02 21:30:21.148250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 457/952] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:20 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:21.375329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:21.376619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:21.378723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:21.383719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:21.384203 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:21.384662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.385719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:21.386845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:21.387277 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.524694 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:21.533624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:21.535136 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:21.536303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7f2e3f4e-cc84-48fc-8edc-58ed5a2bb1ab tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.165445 Sep 02 21:30:21.536858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 496/953] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:21 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:21.824815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:21.825437 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: f8b3ea43-6b55-4349-8138-5503976ddeb2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:21.832165 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:21.832684 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:21.833133 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.833861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:21.834324 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:21.834752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.848637 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] HTTP exception thrown: Instance f8b3ea43-6b55-4349-8138-5503976ddeb2 could not be found. Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Request method failure captured: Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 HTTP/1.1 Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQuA7tr86m4arxlUyz1sKUAwEHai_4Lbj-lbjLGsK0D8VwzMO5HYHfVyme-dtN2n9o9oDWjrb8bC4VcXT_A5AIzkitlo1KlXTYvF5IhqjNxpa-cx0MrRsLQ7OafI1s5xNuMBjK0TqgGEyiJR7OUFvdDhk0a1rWWQCmaEcIS6F4kp-I Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:30:21.850413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}] Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: c81bafbe3e444e84a7da18ac9d782479 Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance f8b3ea43-6b55-4349-8138-5503976ddeb2 could not be found. Sep 02 21:30:21.851759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'f8b3ea43-6b55-4349-8138-5503976ddeb2'} Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8b3ea43-6b55-4349-8138-5503976ddeb2 could not be found. Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:30:21.852490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8b3ea43-6b55-4349-8138-5503976ddeb2 could not be found. Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8b3ea43-6b55-4349-8138-5503976ddeb2 could not be found. Sep 02 21:30:21.854426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:30:21.856182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Returning 404 to user: Instance f8b3ea43-6b55-4349-8138-5503976ddeb2 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:30:21.856182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a70f673e-40f8-43d1-a12f-7fc6f88aba23 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2" status: 404 len: 111 microversion: 2.1 time: 0.032063 Sep 02 21:30:21.856182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 458/954] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:21 2022] GET /compute/v2.1/servers/f8b3ea43-6b55-4349-8138-5503976ddeb2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:21.862540 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:21.863037 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:21.870601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:21.871092 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:21.871520 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.872219 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:21.872671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:21.875505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:21.900114 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:30:22.171253 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:22.171865 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:22.178365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.178851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.179375 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.180087 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.180542 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.182264 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.343314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:22.354110 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7a2b7f5b-b568-41a4-9410-ff655b9badaf tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.186007 Sep 02 21:30:22.355344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 459/955] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:22 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:22.492572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c8ed23a8-88cb-47a1-ad1e-0f5ebc37d1b4 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 204 len: 0 microversion: 2.1 time: 0.633893 Sep 02 21:30:22.493196 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 497/956] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:30:21 2022] DELETE /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:30:22.501924 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:22.502547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:22.508622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.509115 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.510145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.511013 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.511478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.511914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.565688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:22.566441 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:22.573209 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.573698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.574193 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.574888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:22.575335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:22.575784 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:22.697782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:22.705932 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-168e2edf-5149-44d6-8821-64178b420469 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.208245 Sep 02 21:30:22.718069 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 460/957] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:22 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:22.742816 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:22.751705 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:22.753166 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:22.754384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f4d8cb24-f31b-4e82-931d-bd246973ca6e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.194812 Sep 02 21:30:22.754940 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 498/958] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:22 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:23.379457 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:23.380070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:23.386831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.387327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.387769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.388507 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.389055 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.389461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.528953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:23.536801 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9bf392c0-c553-404b-8ea7-0f75e1d8d092 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.161258 Sep 02 21:30:23.537367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 461/959] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:23 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:23.731712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:23.732331 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:23.739375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.739877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.740319 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.741028 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.741487 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.741948 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.780538 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:23.780906 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:23.787154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.787647 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.788219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.788806 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:23.789271 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:23.789705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:23.934361 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:23.942585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-eb03b982-7298-4bc6-b42b-11b984579fcb tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1522 microversion: 2.1 time: 0.215684 Sep 02 21:30:23.943171 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 499/960] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:23 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:23.968646 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:23.977328 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:23.978832 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:23.979999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ca0951d7-301a-49a8-a68e-b38cf69f1d26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.203670 Sep 02 21:30:23.980550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 462/961] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:23 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:24.560744 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:24.561369 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:24.568130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.568625 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.569069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.569792 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.570286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.570714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.725766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:24.734381 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-af4f0c46-79bb-4b71-b5e8-9e2f7d898669 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.177771 Sep 02 21:30:24.735299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 500/962] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:24 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:24.967025 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:24.970250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:24.974861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.975386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.975880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:24.976564 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:24.977017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:24.977437 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.010436 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:25.012718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:25.041880 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.042811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.043572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.044873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.045691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.046458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.068378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.075532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e7e5d12f-5a52-4334-a597-6c7c9147d4e2 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1480 microversion: 2.1 time: 0.112512 Sep 02 21:30:25.076119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 463/963] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:24 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1480 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:25.123339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-8d4cfec3-6106-4e46-848e-b6820827559c req-cd3b9a1d-b79a-41dd-9017-3c3c090be7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3610c813-9d2a-44e4-a9a5-5652a58fd962", "name": "network-vif-deleted", "tag": "abe2a65b-088e-4c84-8bc9-00a0dfa258e3"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:25.133433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8d4cfec3-6106-4e46-848e-b6820827559c req-cd3b9a1d-b79a-41dd-9017-3c3c090be7da service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.133937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8d4cfec3-6106-4e46-848e-b6820827559c req-cd3b9a1d-b79a-41dd-9017-3c3c090be7da service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.134405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8d4cfec3-6106-4e46-848e-b6820827559c req-cd3b9a1d-b79a-41dd-9017-3c3c090be7da service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.147887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-8d4cfec3-6106-4e46-848e-b6820827559c req-cd3b9a1d-b79a-41dd-9017-3c3c090be7da service nova] Creating event network-vif-deleted:abe2a65b-088e-4c84-8bc9-00a0dfa258e3 for instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 on hv-cinder-85220 Sep 02 21:30:25.154333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-8d4cfec3-6106-4e46-848e-b6820827559c req-cd3b9a1d-b79a-41dd-9017-3c3c090be7da service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035415 Sep 02 21:30:25.154975 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 464/964] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:25.210302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.219675 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.221063 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.222365 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-cd9f83fa-b593-4900-84f8-183f62202f53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.219691 Sep 02 21:30:25.222893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 501/965] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:25 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:25.758763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:25.759335 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:25.766709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.767274 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.767685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.768402 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:25.768871 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:25.769418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:25.908492 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:25.916618 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e3b3e401-9d60-4dd3-97f2-c68c472d991d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.162414 Sep 02 21:30:25.926979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 465/966] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:25 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:26.099731 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:26.100277 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:26.107777 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.108273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.108719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.109425 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.109922 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.110351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.175651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:26.184473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7df0b295-7f0a-4e1b-965e-9080473bbb93 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1480 microversion: 2.1 time: 0.088615 Sep 02 21:30:26.185046 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 502/967] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:26 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1480 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:26.249128 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:26.249730 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:26.256544 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.257026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.257463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.258204 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.258657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.259079 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.398263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:26.407138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:26.408617 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:26.409788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6339eb6f-5f5d-4652-af69-9ed6eb32a1c6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.165560 Sep 02 21:30:26.410394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 466/968] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:26 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:26.940270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:26.940746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:26.946921 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.947418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.947853 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:26.948552 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:26.949003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:26.949429 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.103489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.114588 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d645bc90-fc51-4d5c-9f8c-09276ed751bc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.178178 Sep 02 21:30:27.115046 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 503/969] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:26 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:27.211146 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:27.212814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:27.221546 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.222395 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.223116 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.224187 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.224779 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.225489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.265286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.265887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.266299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.266752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lazy-loading 'fault' on Instance uuid 3610c813-9d2a-44e4-a9a5-5652a58fd962 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:27.270198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:27.318861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c81bafbe3e444e84a7da18ac9d782479', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '347df6259a3e48fcbdcbb3f895d38bd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.327754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-baecf839-13e1-46bf-bfee-4184015f76ad tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 200 len: 1311 microversion: 2.1 time: 0.123199 Sep 02 21:30:27.328629 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 467/970] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:27 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 1311 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:27.437123 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:27.437890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:27.444253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.444745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.445189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.445934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:27.446397 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:27.446884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:27.586287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.595722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.597183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:27.598465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-120961a2-3316-4489-be1f-a3550df82e86 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.166558 Sep 02 21:30:27.599027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 504/971] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:27 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:28.139875 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.140469 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.147125 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.153578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.153578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.153578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.153578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.154600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.286888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:28.298979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b1fd90c6-d1d6-46a6-879e-bba2cc7d968c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.164001 Sep 02 21:30:28.299584 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 468/972] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:28.353317 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.354010 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] [instance: 3610c813-9d2a-44e4-a9a5-5652a58fd962] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.361589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.362125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.362563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.363270 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.363724 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.364153 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.380994 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] HTTP exception thrown: Instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 could not be found. Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Request method failure captured: Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 HTTP/1.1 Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQuA7tr86m4arxlUyz1sKUAwEHai_4Lbj-lbjLGsK0D8VwzMO5HYHfVyme-dtN2n9o9oDWjrb8bC4VcXT_A5AIzkitlo1KlXTYvF5IhqjNxpa-cx0MrRsLQ7OafI1s5xNuMBjK0TqgGEyiJR7OUFvdDhk0a1rWWQCmaEcIS6F4kp-I Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:30:28.382805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/347df6259a3e48fcbdcbb3f895d38bd4"}]}] Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 347df6259a3e48fcbdcbb3f895d38bd4 Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1903682069 Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: c81bafbe3e444e84a7da18ac9d782479 Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1903682069-project Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 could not be found. Sep 02 21:30:28.384497 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '3610c813-9d2a-44e4-a9a5-5652a58fd962'} Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 could not be found. Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:30:28.385404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 could not be found. Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 could not be found. Sep 02 21:30:28.386945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:30:28.388393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] Returning 404 to user: Instance 3610c813-9d2a-44e4-a9a5-5652a58fd962 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:30:28.388393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a64fcdf1-a691-44bb-89e6-f26b8c696f50 tempest-ServerRescueNegativeTestJSON-1903682069 tempest-ServerRescueNegativeTestJSON-1903682069-project] 10.222.0.79 "GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962" status: 404 len: 111 microversion: 2.1 time: 0.034904 Sep 02 21:30:28.388393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 505/973] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/3610c813-9d2a-44e4-a9a5-5652a58fd962 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:30:28.624608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.630247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.631853 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.632637 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.632952 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.642701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.643670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.644247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.723292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.726613 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.734624 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.735364 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.735991 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.736964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.737832 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.738737 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.743123 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:28.772416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bad20d9d-5988-4654-8248-658e6316173d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053031 Sep 02 21:30:28.772961 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 506/974] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:28.784898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:28.785483 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:28.793672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.795257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.796566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.796566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:28.797097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:28.797598 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:28.811877 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:28.824283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:28.826567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:28.828486 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-02ca2186-b32f-4459-acf4-317fb14a9dbf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.208035 Sep 02 21:30:28.829112 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 469/975] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:28.833094 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1cdbcd33-1d4a-4238-974d-280850447bbe tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/dd733bdb-aacd-41d2-abc8-43e8b9fe87ed" status: 200 len: 194 microversion: 2.1 time: 0.052155 Sep 02 21:30:28.850663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 507/976] 10.222.0.79 () {58 vars in 1413 bytes} [Fri Sep 2 21:30:28 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/dd733bdb-aacd-41d2-abc8-43e8b9fe87ed => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:29.322839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:29.323511 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:29.336909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.337443 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.339744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.343249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.344985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-04822987-3d16-49ee-a2db-4c994051e9bd req-b1ae5cbb-5dab-48e1-9b74-12703b3283fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86f6c53-b430-449d-9788-8b80d3c3b540", "name": "network-vif-plugged", "status": "completed", "tag": "14b2721f-8d73-4e00-955d-00d02b29a184"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:29.346678 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.348268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.361524 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-04822987-3d16-49ee-a2db-4c994051e9bd req-b1ae5cbb-5dab-48e1-9b74-12703b3283fe service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.364404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-04822987-3d16-49ee-a2db-4c994051e9bd req-b1ae5cbb-5dab-48e1-9b74-12703b3283fe service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.365659 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-04822987-3d16-49ee-a2db-4c994051e9bd req-b1ae5cbb-5dab-48e1-9b74-12703b3283fe service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.381751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-04822987-3d16-49ee-a2db-4c994051e9bd req-b1ae5cbb-5dab-48e1-9b74-12703b3283fe service nova] Creating event network-vif-plugged:14b2721f-8d73-4e00-955d-00d02b29a184 for instance c86f6c53-b430-449d-9788-8b80d3c3b540 on hv-cinder-85220 Sep 02 21:30:29.387871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-04822987-3d16-49ee-a2db-4c994051e9bd req-b1ae5cbb-5dab-48e1-9b74-12703b3283fe service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050989 Sep 02 21:30:29.388938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 508/977] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:29.509484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:29.520211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7862ef27-e76e-4222-8fd3-26dc3560ef53 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.201176 Sep 02 21:30:29.520830 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 470/978] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:29 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:29.856115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:29.857438 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:29.863916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.864406 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.864842 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:29.865587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:29.866069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:29.866594 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.036393 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:30.048597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:30.050268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:30.051746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6f35647e-779f-455f-99e9-169187bc865c tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.200047 Sep 02 21:30:30.053099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 509/979] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:29 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:30.544309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:30.545073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:30.548132 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:30.553533 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.554520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.554958 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.557710 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.558509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.558926 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.760218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff6e0816-2bb0-4076-8cca-cd3c2f3cf66c"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:30.764731 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:30.777861 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.779347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.780137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.781151 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:30.786567 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:30.787276 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:30.825477 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:30.833737 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e07e6df0-c539-4356-a320-3bea317ae53a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.293458 Sep 02 21:30:30.834763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 471/980] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:30 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:31.083690 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:31.084785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:31.093138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.094264 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.095050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.096169 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.096887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.097559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.258211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:31.271188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:31.272679 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:31.273892 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-21e72b64-5291-4101-a1e0-28b5772b6dcc tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.195047 Sep 02 21:30:31.274449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 472/981] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:31 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:31.860688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:31.861319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:31.871557 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.872696 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.873503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:31.874620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:31.875913 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:31.876848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.078356 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:32.088387 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-cbe8d8c0-010c-4ff5-bcc2-9476b48dcf68 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1264 microversion: 2.1 time: 0.233402 Sep 02 21:30:32.089566 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 473/982] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:31 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1264 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:32.116771 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e41d7848-2358-41cc-86d3-7c43512aa21d tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "POST /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.360934 Sep 02 21:30:32.118059 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 510/983] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:30:30 2022] POST /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments => generated 194 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:32.302763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:32.308914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:32.323447 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.323990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.324442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.325858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:32.326453 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:32.326944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:32.545895 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:32.555811 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:32.557259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:32.558467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2aad9c48-153b-4e53-bac6-75c8cdc2528f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.261839 Sep 02 21:30:32.561918 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 474/984] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:32 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:33.114258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:33.115143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:33.128384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.130381 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.130381 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.131666 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.132939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.133369 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.323224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:33.334078 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-94cef46d-5082-430d-a254-3a102738ab84 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1451 microversion: 2.1 time: 0.225200 Sep 02 21:30:33.334752 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 511/985] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:33 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1451 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:33.363104 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:33.363104 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:33.369972 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.370463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.370898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.372150 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.372859 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.373282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.528504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:33.536759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-44984538-39fa-4a33-9292-2a8fc2f3c7d7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1451 microversion: 2.1 time: 0.178144 Sep 02 21:30:33.537338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 475/986] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:33 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1451 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:33.586723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:33.587703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:33.599305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.600429 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.601676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.602492 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:33.603336 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:33.604051 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:33.828348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:33.842000 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:33.843741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:33.844963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-66d0a8be-fe98-49c0-ab57-a116ff686c07 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.264216 Sep 02 21:30:33.845732 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 512/987] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:33 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:34.875103 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:34.878347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:34.886534 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.887622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.888218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:34.888996 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:34.889454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:34.890180 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:35.161472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:35.173079 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:35.174630 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:35.175849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-087485a1-44e1-4c72-b8ec-12c01b749796 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.307046 Sep 02 21:30:35.176949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 476/988] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:34 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:36.204175 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:36.204796 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:36.217302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:36.218461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:36.218918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:36.219736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:36.220318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:36.220943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:36.412676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:36.429546 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:36.431358 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:36.432944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-aeb85d8d-a123-4245-b163-05dde0e13da5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.234347 Sep 02 21:30:36.433910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 513/989] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:36 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:36.592028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-6d2071e7-6d3b-44dc-a227-0c7c252956d6 req-1a1b0432-8aec-40b3-94e5-a9c2347c75b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86f6c53-b430-449d-9788-8b80d3c3b540", "tag": "14b2721f-8d73-4e00-955d-00d02b29a184"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:36.608182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-6d2071e7-6d3b-44dc-a227-0c7c252956d6 req-1a1b0432-8aec-40b3-94e5-a9c2347c75b7 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:36.610294 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-6d2071e7-6d3b-44dc-a227-0c7c252956d6 req-1a1b0432-8aec-40b3-94e5-a9c2347c75b7 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:36.610294 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-6d2071e7-6d3b-44dc-a227-0c7c252956d6 req-1a1b0432-8aec-40b3-94e5-a9c2347c75b7 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:36.621364 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-6d2071e7-6d3b-44dc-a227-0c7c252956d6 req-1a1b0432-8aec-40b3-94e5-a9c2347c75b7 service nova] Creating event network-changed:14b2721f-8d73-4e00-955d-00d02b29a184 for instance c86f6c53-b430-449d-9788-8b80d3c3b540 on hv-cinder-85220 Sep 02 21:30:36.632341 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-6d2071e7-6d3b-44dc-a227-0c7c252956d6 req-1a1b0432-8aec-40b3-94e5-a9c2347c75b7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047651 Sep 02 21:30:36.633481 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 477/990] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:37.460055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:37.461308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:37.468671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:37.469179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:37.469874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:37.472411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:37.472884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:37.473612 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:37.711285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:37.722864 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:37.728618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:37.729962 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e47ff271-82d4-4a2d-9716-9ae92fa4da42 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1744 microversion: 2.20 time: 0.274701 Sep 02 21:30:37.730618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 514/991] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:37 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1744 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:38.758214 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:38.758809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:38.766023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:38.766765 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:38.767201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:38.767996 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:38.768718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:38.769459 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:38.916644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:38.925513 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:38.926990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:38.928309 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6db36b4f-49e3-46eb-84e1-1dd2fa5b77a1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1744 microversion: 2.20 time: 0.175101 Sep 02 21:30:38.930597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 478/992] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:38 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1744 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:39.218171 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-1af0ebaf-14ce-4421-a1af-0796a468e8e8 req-0ef8a413-4a6b-4e90-b82e-b5376c5b1983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7327938c-75f2-41ec-9521-f46cdc14a597", "name": "network-vif-plugged", "status": "completed", "tag": "85b4ae9b-531e-4047-9428-d363ce87d94a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:39.225230 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:39.232807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-1af0ebaf-14ce-4421-a1af-0796a468e8e8 req-0ef8a413-4a6b-4e90-b82e-b5376c5b1983 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:39.233309 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-1af0ebaf-14ce-4421-a1af-0796a468e8e8 req-0ef8a413-4a6b-4e90-b82e-b5376c5b1983 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:39.233740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-1af0ebaf-14ce-4421-a1af-0796a468e8e8 req-0ef8a413-4a6b-4e90-b82e-b5376c5b1983 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:39.247309 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-1af0ebaf-14ce-4421-a1af-0796a468e8e8 req-0ef8a413-4a6b-4e90-b82e-b5376c5b1983 service nova] Creating event network-vif-plugged:85b4ae9b-531e-4047-9428-d363ce87d94a for instance 7327938c-75f2-41ec-9521-f46cdc14a597 on hv-cinder-85220 Sep 02 21:30:39.253288 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-1af0ebaf-14ce-4421-a1af-0796a468e8e8 req-0ef8a413-4a6b-4e90-b82e-b5376c5b1983 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039652 Sep 02 21:30:39.255613 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 515/993] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:39.956316 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:39.957005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:39.964555 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:39.965047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:39.966098 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:39.966818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:39.967273 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:39.967700 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:40.114979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:40.124581 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:40.126097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:40.129986 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-af3edfd0-3cc0-45d9-86f7-7ae31ad002f4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.175928 Sep 02 21:30:40.129986 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 479/994] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:39 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:41.156979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:41.157829 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:41.167900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:41.169982 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:41.170664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:41.178667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:41.179400 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:41.182150 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:41.383735 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:41.395251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:41.397301 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:41.399179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8be05770-84b2-4a75-a494-ed119614666a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.248539 Sep 02 21:30:41.400227 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 516/995] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:41 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:42.095925 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:42.100705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:42.107778 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.111466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.111466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.111466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.111466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.112033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.156195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c388438f-600a-4727-9b28-2fa4593ed2d8 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.067270 Sep 02 21:30:42.165442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 480/996] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:30:42 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:42.313499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:42.316777 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:42.333719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.335662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.336135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.336883 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.337362 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.337850 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.397042 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3a4b130a-22e9-4044-a41c-6afc95db1d23 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/dd733bdb-aacd-41d2-abc8-43e8b9fe87ed" status: 200 len: 194 microversion: 2.1 time: 0.090270 Sep 02 21:30:42.398247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 517/997] 10.222.0.79 () {58 vars in 1413 bytes} [Fri Sep 2 21:30:42 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/dd733bdb-aacd-41d2-abc8-43e8b9fe87ed => generated 194 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:42.409462 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:42.410029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:42.428840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.430307 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.434829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.434829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.435080 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:42.436326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:42.436868 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.437598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.455375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.459478 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.460024 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.460876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:42.463217 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:42.463856 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:42.661391 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lazy-loading 'services' on Instance uuid a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:42.676723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:42.699332 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:42.709918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:42.711017 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5086938e-2ea2-4727-9aeb-52f0050b5bc8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.288607 Sep 02 21:30:42.711901 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 518/998] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:42 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:43.000139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8a722497-3625-4d8b-9182-2c233c2c0df5 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/dd733bdb-aacd-41d2-abc8-43e8b9fe87ed" status: 202 len: 0 microversion: 2.1 time: 0.595292 Sep 02 21:30:43.001396 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 481/999] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:30:42 2022] DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/dd733bdb-aacd-41d2-abc8-43e8b9fe87ed => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:30:43.744204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:43.745501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:43.756966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:43.757865 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:43.758648 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:43.759575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:43.760333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:43.760968 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:43.943490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:43.954910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:43.954910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:43.959103 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d8e1853e-adc4-4ff5-9869-4c9fd46f633a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.217191 Sep 02 21:30:43.971242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 519/1000] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:43 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:44.988071 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:44.988790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:44.995354 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:44.995846 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:44.996323 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:44.997339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:44.997798 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:44.998246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:45.143377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:45.155118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:45.156561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:45.157734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0982fb47-69c6-4d87-83ae-e3f40b01ac26 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.174479 Sep 02 21:30:45.158329 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 482/1001] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:44 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:46.191347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:46.192405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:46.208493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:46.209511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:46.210111 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:46.211143 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:46.212186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:46.213172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:46.455667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:46.481727 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:46.484865 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:46.487456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e9b09ced-dbe7-441a-a0c8-e91d3a327fd0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.304942 Sep 02 21:30:46.488710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 520/1002] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:46 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:47.530625 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:47.531346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:47.540064 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:47.540643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:47.540998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:47.541706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:47.542291 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:47.542639 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:47.782940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:47.797322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:47.798813 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:47.799989 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-803a2511-b40a-438e-878c-ce8e85304785 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.274888 Sep 02 21:30:47.804588 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 483/1003] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:47 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:48.499843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:48.500571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:48.507448 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:48.507909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:48.508347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:48.509046 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:48.509499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:48.509958 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:48.541740 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-75d3a14a-4f3e-4848-aae2-86da5b2e9459 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/ff6e0816-2bb0-4076-8cca-cd3c2f3cf66c" status: 200 len: 194 microversion: 2.1 time: 0.046597 Sep 02 21:30:48.542350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 521/1004] 10.222.0.79 () {58 vars in 1413 bytes} [Fri Sep 2 21:30:48 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/ff6e0816-2bb0-4076-8cca-cd3c2f3cf66c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:48.554203 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:48.554731 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:48.561790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:48.562322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:48.562769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:48.563572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:48.563975 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:48.564405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:48.568765 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:48.655587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lazy-loading 'services' on Instance uuid a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:30:49.016881 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:49.016881 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:49.016881 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:49.016881 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:49.020651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:49.020651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:49.020651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:49.020651 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:49.034198 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:49.037868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:30:49.044191 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:49.047517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:49.047517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b1483e77-4e45-47b6-aac5-3263dcd90379 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.216285 Sep 02 21:30:49.062221 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 522/1005] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:48 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:49.080383 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d9b8749d-7ba7-4285-9759-050dbf00e9bc tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/ff6e0816-2bb0-4076-8cca-cd3c2f3cf66c" status: 202 len: 0 microversion: 2.1 time: 0.529858 Sep 02 21:30:49.085097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 484/1006] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:30:48 2022] DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments/ff6e0816-2bb0-4076-8cca-cd3c2f3cf66c => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:30:50.073329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:50.074297 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:50.088688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:50.089278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:50.089775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:50.090801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:50.091278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:50.091716 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:50.326811 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:50.345613 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:50.348069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:50.350733 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8c30a587-5fd3-46ac-a48e-d298778649b0 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.281777 Sep 02 21:30:50.351923 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 523/1007] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:50 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:51.402252 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:51.404172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:51.411849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.415694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.415694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.415694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.415694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.416076 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.470488 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:51.475674 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:51.498491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.499119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.499571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.500484 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.500749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.503078 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.549030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0b32800f-3a08-4a2a-8f17-9f4dc8db3e09 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083033 Sep 02 21:30:51.550061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 524/1008] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:30:51 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:30:51.624285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:51.639142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:51.640930 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:51.642534 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-33d713b4-c189-4a9b-b213-214d79e34387 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.247832 Sep 02 21:30:51.655245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 485/1009] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:51 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:51.730452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:51.734493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:51.744920 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.746749 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.747652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.748787 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.749504 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.750204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.793013 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0bf40d9e-bbcc-412e-985c-50869ad8e33f tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070735 Sep 02 21:30:51.793990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 525/1010] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:30:51 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:30:51.870791 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:51.872560 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:51.879389 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.879894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.880341 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.881093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:51.882162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:51.882698 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:51.959708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:30:52.677135 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:52.678200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:52.686189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:52.686827 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:52.687295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:52.688055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:52.688583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:52.689035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:52.725975 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7251e1d6-914d-448e-8837-f434fc67a020 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 204 len: 0 microversion: 2.1 time: 0.860939 Sep 02 21:30:52.726799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 486/1011] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:30:51 2022] DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 0 bytes in 864 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:30:52.774702 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:52.775052 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:52.782249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:52.782922 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:52.783380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:52.784206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:52.784737 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:52.785128 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:52.912861 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:52.923070 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:52.924770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:52.926054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5638cd19-6a79-404a-9947-c13c4cc145b4 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.254357 Sep 02 21:30:52.926618 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 526/1012] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:52 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:52.962248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:52.970963 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b2dc2c2e-3644-4ac3-9e43-6d500c3d61a3 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1673 microversion: 2.1 time: 0.201958 Sep 02 21:30:52.971543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 487/1013] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:52 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1673 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:30:53.953637 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:53.954240 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:53.960737 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:53.961224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:53.961658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:53.962389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:53.962846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:53.963265 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:53.995246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:53.996620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:54.003805 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:54.004299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:54.004778 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:54.006455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:54.006455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:54.006455 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:54.180912 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:54.203998 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:54.205849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:54.207693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-39479ce0-bb05-464d-ac04-3d1baf4c7910 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.258455 Sep 02 21:30:54.209350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 527/1014] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:53 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:54.221386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:54.235602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d4ca728f-2244-4844-86cf-aa345c82f6da tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1673 microversion: 2.1 time: 0.244303 Sep 02 21:30:54.237037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 488/1015] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:53 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1673 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:55.253353 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:55.254222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:55.262621 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:55.262911 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:55.263514 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:55.263661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:55.264193 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:55.265572 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:55.266501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:55.267247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:55.270255 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:55.270745 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:55.271826 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:55.278424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:55.278424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:55.278424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:55.488967 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:55.491777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:55.500235 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2edc5f9f-f374-49dd-bde9-9603f881be3b tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1673 microversion: 2.1 time: 0.242500 Sep 02 21:30:55.506601 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 489/1016] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:55 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:55.507087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:55.507087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:55.507087 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c19fddfe-c045-4444-9a49-f061a4813ec6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1739 microversion: 2.20 time: 0.256956 Sep 02 21:30:55.507836 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 528/1017] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:55 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1739 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:56.528367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:56.528367 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:56.534928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:56.535532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:56.536526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:56.537507 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:56.538224 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:56.538898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:56.547088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:56.547757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:56.557232 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:56.558392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:56.559152 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:56.560047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:56.560924 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:56.561800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:56.842629 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:56.843207 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:56.846939 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4dcbca9a-2b2d-4a41-9591-888773529a95 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1673 microversion: 2.1 time: 0.325866 Sep 02 21:30:56.848168 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 490/1018] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:56 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1673 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:56.855349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:56.858416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:56.860988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c9c28a4c-383a-44b4-89ee-525914f32093 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1721 microversion: 2.20 time: 0.325905 Sep 02 21:30:56.862113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 529/1019] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:56 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1721 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:30:57.151316 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-d8cfc76f-2dda-4ee0-b8db-1db8af4e4d0a req-921e2aeb-9ec2-4b6a-ba7c-97cc4d117a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd", "name": "network-vif-deleted", "tag": "cf9887ef-2cab-4e48-ae3a-5e3ed887dcb2"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:57.170754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d8cfc76f-2dda-4ee0-b8db-1db8af4e4d0a req-921e2aeb-9ec2-4b6a-ba7c-97cc4d117a73 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:57.171244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d8cfc76f-2dda-4ee0-b8db-1db8af4e4d0a req-921e2aeb-9ec2-4b6a-ba7c-97cc4d117a73 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:57.171861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-d8cfc76f-2dda-4ee0-b8db-1db8af4e4d0a req-921e2aeb-9ec2-4b6a-ba7c-97cc4d117a73 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:57.189276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-d8cfc76f-2dda-4ee0-b8db-1db8af4e4d0a req-921e2aeb-9ec2-4b6a-ba7c-97cc4d117a73 service nova] Creating event network-vif-deleted:cf9887ef-2cab-4e48-ae3a-5e3ed887dcb2 for instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd on hv-cinder-85220 Sep 02 21:30:57.197572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-d8cfc76f-2dda-4ee0-b8db-1db8af4e4d0a req-921e2aeb-9ec2-4b6a-ba7c-97cc4d117a73 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049863 Sep 02 21:30:57.203366 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 491/1020] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:30:57.883077 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:57.883877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:57.891193 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:57.891704 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:57.892245 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:57.893035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:57.893562 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:57.894091 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:57.894220 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:57.894924 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:57.901948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:57.902572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:57.903100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:57.904308 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:57.904766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:57.905228 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:57.973338 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:57.984405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a61f8230-b72f-450a-b176-3f568f1d6732 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1606 microversion: 2.1 time: 0.104815 Sep 02 21:30:57.993854 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 530/1021] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:57 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1606 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:58.081000 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:58.091711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:58.093166 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:58.094549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-03a650d0-d931-41b3-b546-001d4b04eb70 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1721 microversion: 2.20 time: 0.205344 Sep 02 21:30:58.095107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 492/1022] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:57 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:30:59.010212 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:59.010931 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:59.018096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:59.018653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:59.019273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:59.019981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:59.020432 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:59.020852 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:59.089576 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:59.105776 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ed339d9b-713b-4385-b173-2027e523b4d9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1323 microversion: 2.1 time: 0.098658 Sep 02 21:30:59.106763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 531/1023] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:30:59 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1323 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:30:59.122166 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:30:59.122990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:30:59.130961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:59.131452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:59.131992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:59.132768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:59.133322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:59.133752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:59.303767 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-d045e66f-0a09-4282-8348-1f9c9827af83 req-9ac7de51-4fff-42b3-a666-a804e9d7d57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7327938c-75f2-41ec-9521-f46cdc14a597", "name": "network-vif-unplugged", "status": "completed", "tag": "85b4ae9b-531e-4047-9428-d363ce87d94a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:30:59.326736 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d045e66f-0a09-4282-8348-1f9c9827af83 req-9ac7de51-4fff-42b3-a666-a804e9d7d57f service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:30:59.327176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d045e66f-0a09-4282-8348-1f9c9827af83 req-9ac7de51-4fff-42b3-a666-a804e9d7d57f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:30:59.327601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d045e66f-0a09-4282-8348-1f9c9827af83 req-9ac7de51-4fff-42b3-a666-a804e9d7d57f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:30:59.341179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-d045e66f-0a09-4282-8348-1f9c9827af83 req-9ac7de51-4fff-42b3-a666-a804e9d7d57f service nova] Creating event network-vif-unplugged:85b4ae9b-531e-4047-9428-d363ce87d94a for instance 7327938c-75f2-41ec-9521-f46cdc14a597 on hv-cinder-85220 Sep 02 21:30:59.350252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-d045e66f-0a09-4282-8348-1f9c9827af83 req-9ac7de51-4fff-42b3-a666-a804e9d7d57f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049557 Sep 02 21:30:59.351261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 532/1024] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:30:59.358192 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:59.367176 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:59.368971 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:30:59.369869 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-cd61ddee-8068-4cd1-8e04-7564ebcac9b1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1721 microversion: 2.20 time: 0.252856 Sep 02 21:30:59.371199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 493/1025] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:30:59 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:00.131679 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:00.132386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:00.139134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:00.139557 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:00.139909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:00.140620 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:00.141080 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:00.141506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:00.179238 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:00.179735 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:00.180182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:00.180644 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lazy-loading 'fault' on Instance uuid a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:31:00.231841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cceaf0c4877a4316af9d15c642c9dfc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7b20efaf7e440f9bbf2a1a0df19c556', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:00.241462 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3078d1a3-1681-426c-ac23-c19f97b609ef tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 200 len: 1328 microversion: 2.1 time: 0.114665 Sep 02 21:31:00.247199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 533/1026] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:00 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:31:00.398411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:00.399015 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:00.406265 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:00.406754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:00.407197 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:00.407898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:00.408355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:00.408780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:00.570502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:00.580089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:00.581532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:00.582725 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1681e072-63f8-42e2-b7b9-56514fe33ed5 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1724 microversion: 2.20 time: 0.189850 Sep 02 21:31:00.583285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 494/1027] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:00 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:00.615379 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2947281-7e8f-4221-9ba3-10ccb4fe60c9"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:00.617839 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:00.625177 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:00.625677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:00.626178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:00.626904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:00.627585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:00.628084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:01.265977 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:01.266859 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:01.268814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:01.273741 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:01.274222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:01.274655 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:01.275343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:01.275905 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:01.276372 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:01.291355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] HTTP exception thrown: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Request method failure captured: Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd HTTP/1.1 Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQ0cpYDT6xtDTWg183OYZZfBGSp3Fw1VWLGQI7eNjCA2mf459JXZ8mFsND09DTUMv3-3HfJozSX2Xm6GeUDUyvfv47g7quRwMjyslG3Cl6goMUXcKUZXFw3McnyjnaSW3c3eViZWhnDminUBtrq2yfBBsy3NhPFFDV9dQCjrM-veZI Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:31:01.293705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}] Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: cceaf0c4877a4316af9d15c642c9dfc4 Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:01.295371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd'} Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:31:01.296297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:01.297796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:01.299598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Returning 404 to user: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:31:01.299598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8222f0ce-4d3d-4af0-b5b8-962bf09ba854 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 404 len: 111 microversion: 2.1 time: 0.033203 Sep 02 21:31:01.299598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 495/1028] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:01 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:31:01.305244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c9b83dd3-06c6-4484-ad3a-91023f1b4695 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '.version_select at 0x7fb00cad4af0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:01.423804 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c9b83dd3-06c6-4484-ad3a-91023f1b4695 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863009305" status: 202 len: 0 microversion: 2.1 time: 0.122415 Sep 02 21:31:01.426729 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 496/1029] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Sep 2 21:31:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863009305 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:31:02.129990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-de9beefa-dc86-47a2-b12b-0bbb05a5e879 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.518882 Sep 02 21:31:02.131285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 534/1030] 10.222.0.79 () {62 vars in 1364 bytes} [Fri Sep 2 21:31:00 2022] POST /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/os-volume_attachments => generated 188 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 21:31:02.287465 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:02.287904 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:02.299590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:02.299590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:02.299590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:02.299590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:02.300498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:02.300498 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:03.233112 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-00cb1b54-bc56-444e-848c-6a094e7b679d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/os-volume_attachments/d2947281-7e8f-4221-9ba3-10ccb4fe60c9" status: 202 len: 0 microversion: 2.20 time: 0.950427 Sep 02 21:31:03.233928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 497/1031] 10.222.0.79 () {60 vars in 1457 bytes} [Fri Sep 2 21:31:02 2022] DELETE /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/os-volume_attachments/d2947281-7e8f-4221-9ba3-10ccb4fe60c9 => generated 0 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:31:03.299742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:03.300386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:03.308173 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:03.308774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:03.309220 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:03.310041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:03.310503 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:03.317387 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:03.341926 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121512) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 21:31:03.852711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e573ae45-5b17-4290-81f7-5def460eab7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "POST /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/action" status: 202 len: 0 microversion: 2.20 time: 0.556654 Sep 02 21:31:03.853310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 535/1032] 10.222.0.79 () {62 vars in 1319 bytes} [Fri Sep 2 21:31:03 2022] POST /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/action => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:31:03.864814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:03.864814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:03.874406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:03.874963 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:03.875411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:03.876302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:03.876957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:03.877501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:03.905299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:04.050033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:04.059339 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:04.061282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:04.062874 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-637eadc9-c5c8-4996-a2d1-50ef1d4170a7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1672 microversion: 2.20 time: 0.204731 Sep 02 21:31:04.063424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 498/1033] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:03 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1672 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:05.092722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:05.094278 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:05.104562 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:05.105661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:05.106657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:05.107867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:05.115277 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:05.116102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:05.124402 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:05.260029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:05.260029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:05.260029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:05.260029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:05.261359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:05.261359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:05.261359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:05.261359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:05.275770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] HTTP exception thrown: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Request method failure captured: Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd HTTP/1.1 Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQ0cpYDT6xtDTWg183OYZZfBGSp3Fw1VWLGQI7eNjCA2mf459JXZ8mFsND09DTUMv3-3HfJozSX2Xm6GeUDUyvfv47g7quRwMjyslG3Cl6goMUXcKUZXFw3McnyjnaSW3c3eViZWhnDminUBtrq2yfBBsy3NhPFFDV9dQCjrM-veZI Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:31:05.278041 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}] Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: cceaf0c4877a4316af9d15c642c9dfc4 Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.280948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd'} Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:31:05.282716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.284446 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.285942 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Returning 404 to user: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:31:05.285942 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0e693bf0-63f7-4d2d-8a91-de31264de744 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 404 len: 111 microversion: 2.1 time: 0.036698 Sep 02 21:31:05.285942 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 499/1034] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:31:05 2022] DELETE /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:31:05.288932 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:05.289572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:05.296518 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:05.297000 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:05.297443 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:05.298288 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:05.298788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:05.299270 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:05.314348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] HTTP exception thrown: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Request method failure captured: Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd HTTP/1.1 Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQ0cpYDT6xtDTWg183OYZZfBGSp3Fw1VWLGQI7eNjCA2mf459JXZ8mFsND09DTUMv3-3HfJozSX2Xm6GeUDUyvfv47g7quRwMjyslG3Cl6goMUXcKUZXFw3McnyjnaSW3c3eViZWhnDminUBtrq2yfBBsy3NhPFFDV9dQCjrM-veZI Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:31:05.316012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}] Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: cceaf0c4877a4316af9d15c642c9dfc4 Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.317672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd'} Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:31:05.318664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. Sep 02 21:31:05.320139 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:05.321270 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Returning 404 to user: Instance a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:31:05.321270 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-56dfcaf3-50a1-440e-8605-86bb845dcd92 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd" status: 404 len: 111 microversion: 2.1 time: 0.032715 Sep 02 21:31:05.321270 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 500/1035] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:05 2022] GET /compute/v2.1/servers/a2c3fb72-cdfe-4b04-96c5-d5b72c06e4dd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:31:05.579397 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:05.584257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:05.585746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:05.586987 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a468b0aa-ea03-4f91-917a-35039302c088 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1672 microversion: 2.20 time: 0.501771 Sep 02 21:31:05.587570 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 536/1036] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:05 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1672 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:31:06.614661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:06.615272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:06.623376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:06.626694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:06.626694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:06.626694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:06.626694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:06.627053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:06.788489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:06.798702 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:06.800236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:06.801728 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1819ea90-f6bc-4803-94a6-4db9a9bf4b47 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1674 microversion: 2.20 time: 0.191303 Sep 02 21:31:06.802326 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 501/1037] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:06 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1674 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:06.833027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:06.833616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:06.842479 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:06.847463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:06.847463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:06.847463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:06.847463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:06.847879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:06.863702 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] HTTP exception thrown: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Request method failure captured: Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 HTTP/1.1 Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQ0cpYDT6xtDTWg183OYZZfBGSp3Fw1VWLGQI7eNjCA2mf459JXZ8mFsND09DTUMv3-3HfJozSX2Xm6GeUDUyvfv47g7quRwMjyslG3Cl6goMUXcKUZXFw3McnyjnaSW3c3eViZWhnDminUBtrq2yfBBsy3NhPFFDV9dQCjrM-veZI Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:31:06.865417 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}] Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: cceaf0c4877a4316af9d15c642c9dfc4 Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.867011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': 'c0c79e24-443d-42bb-baa0-e9da52325154'} Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:31:06.867997 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.869616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.871599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Returning 404 to user: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:31:06.871599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-668193df-8841-4bfc-a520-d14c62dd26a9 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 404 len: 111 microversion: 2.1 time: 0.037879 Sep 02 21:31:06.871599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 537/1038] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:31:06 2022] DELETE /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:31:06.876100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:06.881319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] [instance: c0c79e24-443d-42bb-baa0-e9da52325154] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:06.882950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:06.883441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:06.883872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:06.884576 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:06.885030 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:06.885479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:06.899611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] HTTP exception thrown: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Request method failure captured: Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 HTTP/1.1 Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQ0cpYDT6xtDTWg183OYZZfBGSp3Fw1VWLGQI7eNjCA2mf459JXZ8mFsND09DTUMv3-3HfJozSX2Xm6GeUDUyvfv47g7quRwMjyslG3Cl6goMUXcKUZXFw3McnyjnaSW3c3eViZWhnDminUBtrq2yfBBsy3NhPFFDV9dQCjrM-veZI Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:31:06.901764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a7b20efaf7e440f9bbf2a1a0df19c556"}]}] Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: a7b20efaf7e440f9bbf2a1a0df19c556 Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeTestJSON-476440691 Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: cceaf0c4877a4316af9d15c642c9dfc4 Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeTestJSON-476440691-project Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.903976 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'c0c79e24-443d-42bb-baa0-e9da52325154'} Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:31:06.905216 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. Sep 02 21:31:06.906839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:31:06.908334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] Returning 404 to user: Instance c0c79e24-443d-42bb-baa0-e9da52325154 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:31:06.908334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b531b909-e78d-452f-b3ea-07337510bd13 tempest-AttachVolumeTestJSON-476440691 tempest-AttachVolumeTestJSON-476440691-project] 10.222.0.79 "GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154" status: 404 len: 111 microversion: 2.1 time: 0.031279 Sep 02 21:31:06.908334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 502/1039] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:06 2022] GET /compute/v2.1/servers/c0c79e24-443d-42bb-baa0-e9da52325154 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:31:07.832293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:07.833537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:07.844577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:07.846045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:07.846210 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:07.847791 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:07.848617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:07.849840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:08.110714 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:08.122253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:08.124222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:08.125654 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-79866a35-a8be-48a9-b5ed-d1dc1e76c6a3 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.298426 Sep 02 21:31:08.126443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 538/1040] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:07 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:31:09.153540 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:09.154390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:09.161047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:09.161712 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:09.162308 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:09.163268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:09.163813 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:09.164307 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:09.353203 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:09.369212 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:09.375520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:09.377171 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-bab94f8f-63dd-4217-a76d-7e135ff12cb1 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.228231 Sep 02 21:31:09.397834 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 503/1041] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:09 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:10.412303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:10.413013 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:10.431728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:10.433065 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:10.433774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:10.454484 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:10.454484 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:10.454484 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:11.103609 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:11.128089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:11.128089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:11.128089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e49a18e9-562c-4099-8f3f-5b750d4a59df tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.717922 Sep 02 21:31:11.142451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 539/1042] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:10 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:12.176132 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:12.177562 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:12.190183 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:12.191107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:12.192152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:12.193256 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:12.194328 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:12.195337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:12.549638 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:12.566742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:12.574138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:12.585752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-93484c4b-3a4b-4f85-8c08-cbcd38db220f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.403883 Sep 02 21:31:12.585752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 504/1043] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:12 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:13.615795 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:13.618466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:13.623388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:13.629843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:13.631234 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:13.632295 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:13.633970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:13.635640 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:13.637791 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:13.876274 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:13.894866 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:13.898279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:13.901683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fe29243a-37c6-460d-8c57-944927bb330b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.291225 Sep 02 21:31:13.913881 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 540/1044] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:13 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:14.929000 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:14.929569 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:14.938592 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:14.939082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:14.939519 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:14.940432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:14.940888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:14.941314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:15.130595 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:15.144031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:15.148051 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:15.149551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-54911ec4-8abf-4678-819f-b19dc9545491 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.224564 Sep 02 21:31:15.156597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 505/1045] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:14 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:16.186101 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:16.188177 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:16.201882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:16.205038 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:16.205925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:16.209342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:16.213920 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:16.215199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:16.515367 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:16.531723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:16.573893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:16.573893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-35c7afec-11a8-41f3-aba3-732d235699e2 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.361424 Sep 02 21:31:16.573893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 541/1046] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:16 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:17.590840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:17.590840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:17.594820 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:17.595397 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:17.595762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:17.596508 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:17.596971 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:17.597394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:17.760750 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:17.770578 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:17.785768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:17.785768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0de2d37d-92c5-499d-8bb2-02a682bb41f7 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.192413 Sep 02 21:31:17.785768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 506/1047] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:17 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:18.802090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:18.802798 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:18.811024 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:18.820628 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:18.820628 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:18.820628 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:18.820628 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:18.821194 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:19.021265 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:19.030240 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:19.031820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:19.032909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0a059ce5-1eb8-4d32-9e84-74f86cc948b6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.236969 Sep 02 21:31:19.033459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 542/1048] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:18 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:20.061408 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:20.062411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:20.069374 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:20.070264 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:20.070778 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:20.071709 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:20.072484 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:20.073574 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:20.440624 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:20.451193 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:20.453458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:20.455107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-464476bf-5b33-43a1-95ba-cade355bfd57 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.399398 Sep 02 21:31:20.456282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 507/1049] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:20 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:21.488882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:21.489709 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:21.500896 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:21.502155 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:21.503307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:21.505300 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:21.506554 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:21.507485 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:21.715222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:21.727008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:21.729945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:21.731629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-786413bb-98b3-49bf-a2ae-a989556ca168 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.246617 Sep 02 21:31:21.747225 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 543/1050] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:21 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:22.763972 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:22.765412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:22.794464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:22.795028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:22.795442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:22.796174 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:22.797425 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:22.797425 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:23.071237 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:23.082461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:23.082461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:23.083577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-321d9643-ccd5-44a2-8db8-5cd4363a6f2b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.325188 Sep 02 21:31:23.084345 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 508/1051] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:22 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:23.397326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-85963dfe-4aaa-4ca1-952d-461a24455168 req-68187c11-f694-4cdb-9c71-29ad151bd845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7327938c-75f2-41ec-9521-f46cdc14a597", "name": "network-vif-plugged", "status": "completed", "tag": "85b4ae9b-531e-4047-9428-d363ce87d94a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:23.408431 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-85963dfe-4aaa-4ca1-952d-461a24455168 req-68187c11-f694-4cdb-9c71-29ad151bd845 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:23.408920 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-85963dfe-4aaa-4ca1-952d-461a24455168 req-68187c11-f694-4cdb-9c71-29ad151bd845 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:23.409350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-85963dfe-4aaa-4ca1-952d-461a24455168 req-68187c11-f694-4cdb-9c71-29ad151bd845 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:23.422129 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-85963dfe-4aaa-4ca1-952d-461a24455168 req-68187c11-f694-4cdb-9c71-29ad151bd845 service nova] Creating event network-vif-plugged:85b4ae9b-531e-4047-9428-d363ce87d94a for instance 7327938c-75f2-41ec-9521-f46cdc14a597 on hv-cinder-85220 Sep 02 21:31:23.427667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-85963dfe-4aaa-4ca1-952d-461a24455168 req-68187c11-f694-4cdb-9c71-29ad151bd845 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034043 Sep 02 21:31:23.428262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 544/1052] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:24.111635 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:24.112338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:24.120790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:24.121371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:24.121993 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:24.126784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:24.126784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:24.126784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:24.350809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:24.363073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:24.365501 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:24.367552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0fedaa02-2db9-4d92-90d3-53b076d00f27 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.260249 Sep 02 21:31:24.368299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 509/1053] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:24 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 21:31:25.408524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:25.409787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:25.418948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:25.420898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:25.420898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:25.423027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:25.423027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:25.423918 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:25.434911 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-749eadf7-b2f2-496b-bea7-8bc1cd789a12 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: .version_select at 0x7fb00ce943a0>, body: {"keypair": {"name": "tempest-keypair-1308951372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsXbKrNKMSnGpEWqp6YXHZTnEYdgrVxWKgIeVybn2Bb6xxEZkxd22ZdONOJyJkrNa2byyEiwlatT9EeKJoGO//h6YJpreYvmzlUsFN89q8GYkSLTD0s0o8f0FblYZALeA=="}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:25.455418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-749eadf7-b2f2-496b-bea7-8bc1cd789a12 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:31:25.460605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-749eadf7-b2f2-496b-bea7-8bc1cd789a12 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for user e343f998e5e34447bd2b5f0a2627bbdf and project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:31:25.570454 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-749eadf7-b2f2-496b-bea7-8bc1cd789a12 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.299753 Sep 02 21:31:25.571056 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 545/1054] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:31:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:25.613276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:25.623922 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:25.625285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:25.626532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1cc2cbe9-9c5a-491d-9c61-da635bb07b53 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.223237 Sep 02 21:31:25.631937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 510/1055] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:25 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:26.655247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:26.655899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:26.663542 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:26.664036 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:26.664472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:26.665188 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:26.665639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:26.666671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:26.825473 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:26.837282 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:26.840134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:26.841415 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6c3b9fe9-2b1a-4a70-86da-cebe269dcf2a tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.191227 Sep 02 21:31:26.842022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 546/1056] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:26 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:27.874547 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:27.876254 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:27.885978 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:27.886962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:27.889584 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:27.892226 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:27.892962 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:27.893757 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:28.105474 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:28.115540 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:28.117735 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:28.119940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c8632e85-a683-4371-85b9-2c99e2228e7f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.254516 Sep 02 21:31:28.120928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 511/1057] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:27 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:28.642522 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-792673622", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ea88b9b-407d-410e-a71a-923bd00def20"}], "security_groups": [{"name": "tempest-securitygroup--1507638312"}], "key_name": "tempest-keypair-1308951372", "user_data": "}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:28.792750 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.network.neutron [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] validate_networks() for [('4ea88b9b-407d-410e-a71a-923bd00def20', None, None, None, None, None)] {{(pid=121512) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:31:29.149906 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:29.152072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:29.160064 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:29.160567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:29.161034 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:29.161996 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:29.162466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:29.162873 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:29.432139 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Flavor limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:31:29.433367 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Image limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:31:29.435015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Flavor pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:31:29.435855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Image pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:31:29.436664 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:31:29.451592 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:29.452495 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:29.455955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:29.462185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:29.463699 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:29.464370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:29.464980 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:29.469161 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:29.471217 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:29.472721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b146e077-a66e-4c8b-b448-53523ea93274 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.329177 Sep 02 21:31:29.481718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 512/1058] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:29 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:29.517016 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:31:29.528943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for user e343f998e5e34447bd2b5f0a2627bbdf and project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:31:29.546800 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Going to run 1 instances... {{(pid=121512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:31:29.551082 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:31:29.693598 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0793d06d-0612-4e73-a00a-4b04e0865671 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.056391 Sep 02 21:31:29.695169 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 547/1059] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:31:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:31:29.731261 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cf35f479-d873-4df3-b398-03ecfd5e8bf2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:29.732000 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-cf35f479-d873-4df3-b398-03ecfd5e8bf2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:29.828101 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-cf35f479-d873-4df3-b398-03ecfd5e8bf2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:29.836385 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-cf35f479-d873-4df3-b398-03ecfd5e8bf2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1241 microversion: 2.1 time: 0.132125 Sep 02 21:31:29.836961 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 513/1060] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:29 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:30.502340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:30.502975 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:30.511550 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:30.512054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:30.512493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:30.513222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:30.513681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:30.514137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:30.674870 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:30.684550 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:30.686069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:30.687263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-42a7e19f-a04d-4673-ab7d-50a2984a1898 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1730 microversion: 2.20 time: 0.191386 Sep 02 21:31:30.688081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 548/1061] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:30 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:30.862461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5429729d-cfc1-46d9-8b9a-15ed38ea9e04 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:30.863066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5429729d-cfc1-46d9-8b9a-15ed38ea9e04 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:30.940347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5429729d-cfc1-46d9-8b9a-15ed38ea9e04 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:30.949678 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5429729d-cfc1-46d9-8b9a-15ed38ea9e04 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1241 microversion: 2.1 time: 0.090999 Sep 02 21:31:30.950292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 514/1062] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:30 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:31.713614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:31.714553 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:31.721665 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:31.722199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:31.722626 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:31.723407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:31.723785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:31.724210 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:31.883195 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:31.892815 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:31.894337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:31.895423 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-437c8f7e-f3b7-4523-90ce-cd550928943f tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1717 microversion: 2.20 time: 0.186731 Sep 02 21:31:31.896263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 549/1063] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:31:31 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:31:31.978391 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:31.979521 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:31.991071 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:31.991849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:31.992627 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:31.994867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:31.995710 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:31.996471 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:32.065052 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:32.074404 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-aa5e931e-7b0e-4419-ab18-04480ff42376 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1245 microversion: 2.1 time: 0.102454 Sep 02 21:31:32.075394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 515/1064] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:31 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:33.099426 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:33.099959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:33.108025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:33.108516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:33.108951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:33.109660 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:33.110156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:33.110591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:33.177533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:33.186604 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6ec5974e-272b-43bb-88ad-b064eef10029 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1293 microversion: 2.1 time: 0.091309 Sep 02 21:31:33.187179 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 550/1065] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:33 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:34.211491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:34.212903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:34.217329 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:34.221169 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:34.221665 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:34.222450 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:34.223649 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:34.224426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:34.225025 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:34.295208 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:34.303108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-24533e6f-dd25-4fe0-8afa-3f1b6c63ac4e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1299 microversion: 2.1 time: 0.095540 Sep 02 21:31:34.305251 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 516/1066] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:34 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:31:35.327868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:35.328456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:35.335758 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:35.336254 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:35.336693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:35.337518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:35.338326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:35.338751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:35.504929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:35.513625 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0381dcd2-633f-4233-9465-ba011f3b6803 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1367 microversion: 2.1 time: 0.190355 Sep 02 21:31:35.514246 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 551/1067] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:35 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:35.914527 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-73a2409f-d495-4fad-ab1d-42eb01df6a7d req-2c497037-aa3d-4492-a7a9-72c75272f59c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82", "tag": "7d4a4424-af7b-47c8-93f8-df147eb9efd5"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:35.928595 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-73a2409f-d495-4fad-ab1d-42eb01df6a7d req-2c497037-aa3d-4492-a7a9-72c75272f59c service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:35.929078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-73a2409f-d495-4fad-ab1d-42eb01df6a7d req-2c497037-aa3d-4492-a7a9-72c75272f59c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:35.929830 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-73a2409f-d495-4fad-ab1d-42eb01df6a7d req-2c497037-aa3d-4492-a7a9-72c75272f59c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:35.944615 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-73a2409f-d495-4fad-ab1d-42eb01df6a7d req-2c497037-aa3d-4492-a7a9-72c75272f59c service nova] Creating event network-changed:7d4a4424-af7b-47c8-93f8-df147eb9efd5 for instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 on hv-cinder-85220 Sep 02 21:31:35.952302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-73a2409f-d495-4fad-ab1d-42eb01df6a7d req-2c497037-aa3d-4492-a7a9-72c75272f59c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048459 Sep 02 21:31:35.953106 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 517/1068] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:36.537063 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:36.537689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:36.545327 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:36.546287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:36.546672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:36.547521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:36.547873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:36.549428 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:36.689475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:36.699050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-156f2459-3c39-4844-946a-8c69ee0a2f52 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1367 microversion: 2.1 time: 0.165312 Sep 02 21:31:36.699930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 552/1069] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:36 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:31:37.723960 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:37.725203 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:37.740368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:37.740368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:37.740368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:37.740368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:37.740776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:37.740776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:37.744506 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=90 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:37.907023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:37.915867 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2fab8830-0dcc-42f5-a585-9bab02c44fd5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1367 microversion: 2.1 time: 0.195966 Sep 02 21:31:37.927297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 518/1070] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:37 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:38.943001 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:38.943614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:38.950558 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:38.950982 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:38.951426 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:38.952137 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:38.952593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:38.953025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:38.955942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=83 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:39.107226 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:39.114521 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-78073741-558e-4f19-b2e8-5abc0bfe5d9f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1367 microversion: 2.1 time: 0.175304 Sep 02 21:31:39.115447 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 553/1071] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:38 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:40.138857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:40.139766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:40.158743 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:40.159358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:40.161145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:40.161145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:40.161418 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:40.162814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:40.304472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:40.314355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dd178b48-396e-435c-a053-a1bc6e4fee70 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1367 microversion: 2.1 time: 0.179404 Sep 02 21:31:40.315003 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 519/1072] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:40 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:41.339333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:41.340165 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:41.342019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:41.342713 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=10 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:41.348516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:41.349005 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:41.349506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:41.350225 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:41.350676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:41.351102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:41.496373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:41.504180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-02498ce6-dd99-4822-80ef-eb38f8d492a6 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1367 microversion: 2.1 time: 0.169643 Sep 02 21:31:41.509318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 554/1073] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:41 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:31:42.487552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-3c812068-0b95-4e9a-b113-d49f269b89bc req-9fe61cb6-ab45-46e9-8022-150744e3d34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82", "name": "network-vif-plugged", "status": "completed", "tag": "7d4a4424-af7b-47c8-93f8-df147eb9efd5"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:42.493472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=4 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:31:42.500806 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-3c812068-0b95-4e9a-b113-d49f269b89bc req-9fe61cb6-ab45-46e9-8022-150744e3d34c service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:42.501668 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-3c812068-0b95-4e9a-b113-d49f269b89bc req-9fe61cb6-ab45-46e9-8022-150744e3d34c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:42.502194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-3c812068-0b95-4e9a-b113-d49f269b89bc req-9fe61cb6-ab45-46e9-8022-150744e3d34c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:42.514844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-3c812068-0b95-4e9a-b113-d49f269b89bc req-9fe61cb6-ab45-46e9-8022-150744e3d34c service nova] Creating event network-vif-plugged:7d4a4424-af7b-47c8-93f8-df147eb9efd5 for instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 on hv-cinder-85220 Sep 02 21:31:42.521010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-3c812068-0b95-4e9a-b113-d49f269b89bc req-9fe61cb6-ab45-46e9-8022-150744e3d34c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037256 Sep 02 21:31:42.525667 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 520/1074] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:42.533429 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:42.534222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:42.545309 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:42.545941 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:42.550649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:42.550649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:42.550649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:42.550649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:42.741616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:42.750537 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-53e621d8-0ef3-4d7c-9be7-2ed381656b7d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1367 microversion: 2.1 time: 0.221145 Sep 02 21:31:42.751364 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 555/1075] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:42 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:43.785756 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:43.786699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:43.794452 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:43.794937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:43.795365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:43.796073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:43.796520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:43.796940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:43.988878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:43.997725 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-cbdc1d0e-d1ec-4f07-83e2-526d5520a5be tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1367 microversion: 2.1 time: 0.217237 Sep 02 21:31:43.998577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 521/1076] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:43 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:45.023450 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:45.024555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:45.033198 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:45.033695 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:45.034291 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:45.034890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:45.035315 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:45.036575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:45.182149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:31:45.191012 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-faf2ccbc-bd67-4e0c-84ad-dca7e307ef00 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1558 microversion: 2.1 time: 0.172104 Sep 02 21:31:45.191595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 556/1077] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:31:45 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:31:45.216746 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:31:45.217336 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:31:45.227132 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:45.227748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:45.228100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:45.228812 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:45.229267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:45.229684 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:45.317950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4e018949-60a1-444e-9d3d-f1c73ca9cdd3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.105790 Sep 02 21:31:45.318637 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 522/1078] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Sep 2 21:31:45 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:31:46.811304 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-22ce8b7d-8cd6-449d-86bb-e035a532c775 req-7a5aa816-bf9f-46da-8d11-162a17319640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82", "tag": "7d4a4424-af7b-47c8-93f8-df147eb9efd5"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:31:46.827480 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-22ce8b7d-8cd6-449d-86bb-e035a532c775 req-7a5aa816-bf9f-46da-8d11-162a17319640 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:31:46.828212 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-22ce8b7d-8cd6-449d-86bb-e035a532c775 req-7a5aa816-bf9f-46da-8d11-162a17319640 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:31:46.828639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-22ce8b7d-8cd6-449d-86bb-e035a532c775 req-7a5aa816-bf9f-46da-8d11-162a17319640 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:31:46.842715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-22ce8b7d-8cd6-449d-86bb-e035a532c775 req-7a5aa816-bf9f-46da-8d11-162a17319640 service nova] Creating event network-changed:7d4a4424-af7b-47c8-93f8-df147eb9efd5 for instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 on hv-cinder-85220 Sep 02 21:31:46.849547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-22ce8b7d-8cd6-449d-86bb-e035a532c775 req-7a5aa816-bf9f-46da-8d11-162a17319640 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041470 Sep 02 21:31:46.850378 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 557/1079] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:04.762444 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=13 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:04.764633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=23 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:04.770148 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:04.772347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:04.778784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.779274 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.779755 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.780784 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.781790 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.782271 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.814552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d1007482-9e64-4199-85af-b15edec66202 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.062586 Sep 02 21:32:04.815176 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 523/1080] 10.222.0.79 () {60 vars in 1343 bytes} [Fri Sep 2 21:32:04 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:04.886981 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:04.888166 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:04.891324 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:04.892007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=25 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:04.898077 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.898576 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.899019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.899734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:04.900197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:04.900635 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:04.929340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:32:05.281469 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-945c0771-48df-498f-a1d9-b6f9df6013f6 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 204 len: 0 microversion: 2.20 time: 0.397550 Sep 02 21:32:05.282489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 558/1081] 10.222.0.79 () {60 vars in 1280 bytes} [Fri Sep 2 21:32:04 2022] DELETE /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 21:32:05.292226 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:05.292919 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:05.300405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.300903 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.301344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.302086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:05.302612 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:05.303062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:05.441864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:05.450719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:05.457783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:05.457783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5f34c0c3-924c-4308-9396-0d13c7828a88 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.165982 Sep 02 21:32:05.457783 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 524/1082] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:32:05 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:32:06.480359 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:06.481581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:06.488760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:06.489247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:06.489687 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:06.490432 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:06.491146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:06.491667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:06.627595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:06.636129 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:06.637587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:06.638804 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4aba0db6-d0ba-4369-abb2-03072e16887d tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.162823 Sep 02 21:32:06.639415 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 559/1083] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:32:06 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:32:07.666437 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:07.667245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:07.675214 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:07.675214 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:07.676099 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:07.676204 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:07.676658 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:07.677763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:07.818835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:07.829162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:07.831040 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:07.832502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-362efacc-8490-4a80-ba53-e27fe8dbdebf tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1723 microversion: 2.20 time: 0.171394 Sep 02 21:32:07.834016 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 525/1084] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:32:07 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:32:08.164771 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-4229ed6d-d9b4-42de-a0d3-f6646faf57ca req-7f28afea-35e0-4c50-8c77-00ce4f2bdd82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7327938c-75f2-41ec-9521-f46cdc14a597", "name": "network-vif-deleted", "tag": "85b4ae9b-531e-4047-9428-d363ce87d94a"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:08.179314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-4229ed6d-d9b4-42de-a0d3-f6646faf57ca req-7f28afea-35e0-4c50-8c77-00ce4f2bdd82 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:08.179314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-4229ed6d-d9b4-42de-a0d3-f6646faf57ca req-7f28afea-35e0-4c50-8c77-00ce4f2bdd82 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:08.179314 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-4229ed6d-d9b4-42de-a0d3-f6646faf57ca req-7f28afea-35e0-4c50-8c77-00ce4f2bdd82 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:08.192642 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-4229ed6d-d9b4-42de-a0d3-f6646faf57ca req-7f28afea-35e0-4c50-8c77-00ce4f2bdd82 service nova] Creating event network-vif-deleted:85b4ae9b-531e-4047-9428-d363ce87d94a for instance 7327938c-75f2-41ec-9521-f46cdc14a597 on hv-cinder-85220 Sep 02 21:32:08.197921 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-4229ed6d-d9b4-42de-a0d3-f6646faf57ca req-7f28afea-35e0-4c50-8c77-00ce4f2bdd82 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037430 Sep 02 21:32:08.199114 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 560/1085] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:08.870773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:08.872101 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:08.888759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:08.891352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:08.892239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:08.893874 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:08.894411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:08.895302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:08.997499 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:08.998033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:08.998721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:08.999205 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lazy-loading 'fault' on Instance uuid 7327938c-75f2-41ec-9521-f46cdc14a597 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:09.052140 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:09.068979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:09.070609 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa84378418324708b40f0791e2217ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dbbc6a603794466b64e5822ea9a19f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:09.071808 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b491be45-439d-4706-bdba-83be6acb206b tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 200 len: 1370 microversion: 2.20 time: 0.208608 Sep 02 21:32:09.072355 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 526/1086] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:32:08 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 21:32:10.103088 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:10.103944 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:10.111312 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:10.111868 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:10.112231 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:10.112938 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:10.113384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:10.113826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:10.129043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] HTTP exception thrown: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Request method failure captured: Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 HTTP/1.1 Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQy71HF9KZ8UBg0-6XcTI45O71PUDqAblRMYVJiIGzJWEav4dOA1Yv0-JEGMa03gxRjZB2IE74GM_lXs4OyCvZBoqBc3siWSGmCYbkL4WDYmoHMNX81ir9S48qu4ytxuCNOHxaR8MdkSHf4bwevSgULMeIJi9w0GOKc7mId-_oKKtA Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:32:10.130810 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}] Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: aa84378418324708b40f0791e2217ccc Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:10.132801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '7327938c-75f2-41ec-9521-f46cdc14a597'} Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:10.133681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:10.135255 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:10.136756 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Returning 404 to user: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:10.136756 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0a7f7c79-db45-45ab-a003-608f6ee14d23 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 404 len: 111 microversion: 2.20 time: 0.034309 Sep 02 21:32:10.136756 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 561/1087] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:32:10 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:32:10.142250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ad4b44a4-2af5-4ea6-bcd9-c0de6ea51388 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '.version_select at 0x7fb00cad43a0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:10.241160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ad4b44a4-2af5-4ea6-bcd9-c0de6ea51388 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112291069" status: 204 len: 0 microversion: 2.20 time: 0.102919 Sep 02 21:32:10.241788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 527/1088] 10.222.0.79 () {60 vars in 1259 bytes} [Fri Sep 2 21:32:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112291069 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 21:32:10.842568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:10.844171 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:10.850657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:10.851249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:10.851698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:10.852404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:10.853066 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:10.853851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:10.883027 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lazy-loading 'flavor' on Instance uuid bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:11.238852 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8d628acf-7e08-4292-ba06-782f17762060 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "POST /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9/action" status: 202 len: 0 microversion: 2.1 time: 0.400267 Sep 02 21:32:11.240501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 562/1089] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:32:10 2022] POST /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:32:11.250677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:11.251914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:11.259435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:11.260044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:11.261999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:11.261999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:11.261999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:11.262730 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:11.418118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:11.428117 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-22133f16-ffbe-44dd-923d-36ecc3e7679b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.183261 Sep 02 21:32:11.428908 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 528/1090] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:11 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:12.454515 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:12.455233 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:12.462877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.463264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.463785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.464463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.464923 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.465437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.471888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:12.473135 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:12.479193 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.479676 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.480174 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.483044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.483044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.483044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.496487 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] HTTP exception thrown: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Request method failure captured: Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: DELETE /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 HTTP/1.1 Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQy71HF9KZ8UBg0-6XcTI45O71PUDqAblRMYVJiIGzJWEav4dOA1Yv0-JEGMa03gxRjZB2IE74GM_lXs4OyCvZBoqBc3siWSGmCYbkL4WDYmoHMNX81ir9S48qu4ytxuCNOHxaR8MdkSHf4bwevSgULMeIJi9w0GOKc7mId-_oKKtA Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:32:12.498213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}] Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: aa84378418324708b40f0791e2217ccc Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.500672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '7327938c-75f2-41ec-9521-f46cdc14a597'} Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:12.501664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.504189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.505664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Returning 404 to user: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:12.505664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5ff4647e-80f9-4602-9b93-4cd2f4363c9e tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "DELETE /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 404 len: 111 microversion: 2.20 time: 0.032521 Sep 02 21:32:12.505664 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 529/1091] 10.222.0.79 () {60 vars in 1280 bytes} [Fri Sep 2 21:32:12 2022] DELETE /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:32:12.511267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:12.511267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 7327938c-75f2-41ec-9521-f46cdc14a597] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:12.515526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.516141 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.516688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.517392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:12.517864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:12.518290 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:12.533747 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] HTTP exception thrown: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Request method failure captured: Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 HTTP/1.1 Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQy71HF9KZ8UBg0-6XcTI45O71PUDqAblRMYVJiIGzJWEav4dOA1Yv0-JEGMa03gxRjZB2IE74GM_lXs4OyCvZBoqBc3siWSGmCYbkL4WDYmoHMNX81ir9S48qu4ytxuCNOHxaR8MdkSHf4bwevSgULMeIJi9w0GOKc7mId-_oKKtA Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:32:12.535342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}] Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: aa84378418324708b40f0791e2217ccc Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.537343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '7327938c-75f2-41ec-9521-f46cdc14a597'} Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:12.538432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. Sep 02 21:32:12.539851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:12.541185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Returning 404 to user: Instance 7327938c-75f2-41ec-9521-f46cdc14a597 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:12.541185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-65e68d99-5d0a-4674-9107-20184b9cb533 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597" status: 404 len: 111 microversion: 2.20 time: 0.032364 Sep 02 21:32:12.541185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 530/1092] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:32:12 2022] GET /compute/v2.1/servers/7327938c-75f2-41ec-9521-f46cdc14a597 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 21:32:12.615755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:12.623593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-57ca8213-42f4-48b0-872a-24f5a8ea369b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.174657 Sep 02 21:32:12.624263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 563/1093] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:12 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:13.647918 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:13.648772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:13.655331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.656949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.656949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.657524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.658047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.658597 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.801263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:13.815045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9a40dc72-42dd-4621-9bcf-fc34ef5bcadc tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.170897 Sep 02 21:32:13.815656 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 531/1094] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:13 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:13.957205 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:13.957703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:13.966616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.966616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.966616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.966616 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:13.971060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:13.971060 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:13.982776 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] HTTP exception thrown: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Request method failure captured: Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f HTTP/1.1 Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnQy71HF9KZ8UBg0-6XcTI45O71PUDqAblRMYVJiIGzJWEav4dOA1Yv0-JEGMa03gxRjZB2IE74GM_lXs4OyCvZBoqBc3siWSGmCYbkL4WDYmoHMNX81ir9S48qu4ytxuCNOHxaR8MdkSHf4bwevSgULMeIJi9w0GOKc7mId-_oKKtA Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:32:13.985258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}] Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: aa84378418324708b40f0791e2217ccc Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:13.987073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '4f5852d6-c6ee-489d-a2cd-a1ce7008540f'} Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:13.988040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:13.989571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:13.992437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Returning 404 to user: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:13.992437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7da14df6-a596-4181-9c8e-30f32526ffb8 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 404 len: 111 microversion: 2.20 time: 0.033978 Sep 02 21:32:13.992437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 564/1095] 10.222.0.79 () {60 vars in 1280 bytes} [Fri Sep 2 21:32:13 2022] DELETE /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 21:32:13.995748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:13.996374 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] [instance: 4f5852d6-c6ee-489d-a2cd-a1ce7008540f] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:14.002363 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.002854 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.010818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.010818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.010818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.010818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.018721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] HTTP exception thrown: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Request method failure captured: Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f HTTP/1.1 Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnQy71HF9KZ8UBg0-6XcTI45O71PUDqAblRMYVJiIGzJWEav4dOA1Yv0-JEGMa03gxRjZB2IE74GM_lXs4OyCvZBoqBc3siWSGmCYbkL4WDYmoHMNX81ir9S48qu4ytxuCNOHxaR8MdkSHf4bwevSgULMeIJi9w0GOKc7mId-_oKKtA Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Openstack-Nova-Api-Version: 2.20 Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:32:14.020263 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/6dbbc6a603794466b64e5822ea9a19f3"}]}] Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 6dbbc6a603794466b64e5822ea9a19f3 Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-791942467 Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: aa84378418324708b40f0791e2217ccc Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeShelveTestJSON-791942467-project Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:14.022136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '4f5852d6-c6ee-489d-a2cd-a1ce7008540f'} Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:14.023086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. Sep 02 21:32:14.024653 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:32:14.026199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] Returning 404 to user: Instance 4f5852d6-c6ee-489d-a2cd-a1ce7008540f could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:14.026199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4382555b-d14e-46a1-a503-c3c6a2fa0d31 tempest-AttachVolumeShelveTestJSON-791942467 tempest-AttachVolumeShelveTestJSON-791942467-project] 10.222.0.79 "GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f" status: 404 len: 111 microversion: 2.20 time: 0.029859 Sep 02 21:32:14.026199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 532/1096] 10.222.0.79 () {60 vars in 1277 bytes} [Fri Sep 2 21:32:13 2022] GET /compute/v2.1/servers/4f5852d6-c6ee-489d-a2cd-a1ce7008540f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 02 21:32:14.838299 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:14.838838 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:14.845452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.845979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.846424 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:14.847140 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:14.847609 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:14.848047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:15.058241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:15.067667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6de700ca-b695-419d-bf63-7b906caf90c8 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.233192 Sep 02 21:32:15.068539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 565/1097] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:14 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:16.100173 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:16.101718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:16.120822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:16.121583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:16.123086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:16.126005 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:16.129411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:16.131643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:16.385649 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:16.402872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-13dc98d6-15b4-4d35-bab7-7cc9a19eb8b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.312600 Sep 02 21:32:16.404900 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 533/1098] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:16 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:17.446239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:17.446873 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:17.453855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:17.454355 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:17.454798 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:17.455512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:17.455968 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:17.456396 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:17.616646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:17.626715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-448112f7-7272-4756-8a4d-a3cd5a2429d2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.184471 Sep 02 21:32:17.627686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 566/1099] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:17 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:18.651343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:18.652073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:18.658934 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:18.659414 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:18.659852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.660589 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:18.661138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:18.661615 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:18.851238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:18.865080 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2fec6ff5-b0f2-455e-a2f2-c2a49aad34fb tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.217044 Sep 02 21:32:18.866249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 534/1100] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:18 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:19.897140 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:19.898115 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:19.904648 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.905159 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.906130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:19.906829 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:19.907277 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:19.907708 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:20.049499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:20.058125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-220061c1-5991-4073-a784-cb0b3b7e4904 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.168596 Sep 02 21:32:20.058700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 567/1101] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:19 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:20.450899 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-614739649", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:20.522279 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] validate_networks() for None {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:32:21.082766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:21.084073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:21.090876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:21.091375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:21.091821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:21.092591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:21.093065 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:21.093495 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:21.110551 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:32:21.110848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:32:21.111306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:32:21.111712 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:32:21.112333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:32:21.121970 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:21.122472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:21.122912 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:21.123642 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:21.126175 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:21.126175 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:21.146260 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Getting quotas for project 3bc1a0a5f86e4a48b2442c9ae0b6457c. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:32:21.151860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Getting quotas for user e1ce89c776494d41a3f5cf18076a688c and project 3bc1a0a5f86e4a48b2442c9ae0b6457c. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:32:21.167186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:32:21.169509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:32:21.252575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:21.263696 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fc66bc29-10f2-4a48-8b80-a47a950e3f3b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.184570 Sep 02 21:32:21.264513 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 568/1102] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:21 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:21.331704 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-07108c38-72df-4e5c-8ab7-1d53c4fa69f5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884535 Sep 02 21:32:21.332582 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 535/1103] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:32:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 02 21:32:21.346362 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9d0846ec-7e1d-4a08-86b8-816b09892e2f tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:21.347680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9d0846ec-7e1d-4a08-86b8-816b09892e2f tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:21.409101 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9d0846ec-7e1d-4a08-86b8-816b09892e2f tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:21.417577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9d0846ec-7e1d-4a08-86b8-816b09892e2f tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1214 microversion: 2.1 time: 0.077090 Sep 02 21:32:21.418281 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 569/1104] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:21 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:22.291716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:22.298388 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:22.304950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:22.305358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:22.306022 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:22.307119 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:22.307782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:22.308488 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:22.445156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-fa25d837-cf62-4241-b27f-63853cf41d7c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:22.446445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-fa25d837-cf62-4241-b27f-63853cf41d7c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:22.471661 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:22.488703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c7d4c347-8af1-49c5-a7eb-52a980f0916e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.204604 Sep 02 21:32:22.490641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 536/1105] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:22 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:22.521698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-fa25d837-cf62-4241-b27f-63853cf41d7c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:22.527715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-fa25d837-cf62-4241-b27f-63853cf41d7c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1214 microversion: 2.1 time: 0.088303 Sep 02 21:32:22.528313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 570/1106] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:22 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:23.513633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:23.515077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:23.521771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:23.522358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:23.522866 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:23.523555 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:23.524006 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:23.524422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:23.551728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:23.552544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:23.558794 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:23.559356 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:23.559935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:23.560693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:23.561281 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:23.561850 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:23.636587 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:23.645370 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-90e9afb8-5ce2-4130-a665-ced66131092c tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1218 microversion: 2.1 time: 0.097478 Sep 02 21:32:23.658165 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 571/1107] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:23 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:23.721836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:23.734239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-98361b11-b2ba-47e6-a06e-18617a479568 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.225238 Sep 02 21:32:23.734770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 537/1108] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:23 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:24.671825 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:24.674076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:24.682266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.683092 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.683681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.684510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.685176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.686955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.760067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:24.760725 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:24.771186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.772031 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.772796 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.776415 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:24.778178 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:24.779451 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:24.793106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:24.803803 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-cb44199b-ff23-4011-82e3-84e67bed385e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1210 microversion: 2.1 time: 0.137477 Sep 02 21:32:24.804696 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 572/1109] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:24 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1210 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:24.974627 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:24.988759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a8c1d5a8-2839-4d93-b5dc-5dba9742b921 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.231929 Sep 02 21:32:24.991394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 538/1110] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:24 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:25.832134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:25.833562 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:25.850565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:25.850565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:25.850565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:25.850565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:25.851047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:25.851047 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:25.930899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:25.941684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-20ec5ce6-1f24-4f47-8776-ccdc5915eaa1 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1274 microversion: 2.1 time: 0.115385 Sep 02 21:32:25.942783 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 573/1111] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:25 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:26.025316 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:26.025985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:26.038300 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.040777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.040777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.040777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.040777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.041133 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.330334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:26.339021 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5115dbf0-6e83-4a74-85e4-d59f2334146b tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1568 microversion: 2.1 time: 0.320951 Sep 02 21:32:26.339608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 539/1112] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:26 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1568 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:26.369723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:26.370113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:26.377259 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.377779 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.378274 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.379094 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.379601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.380277 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.423807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121512) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 02 21:32:26.568097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:26.797239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f102c53d-9423-418a-ac99-87047e6c9ef2 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "POST /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9/action" status: 202 len: 0 microversion: 2.1 time: 0.431617 Sep 02 21:32:26.799208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 574/1113] 10.222.0.79 () {60 vars in 1278 bytes} [Fri Sep 2 21:32:26 2022] POST /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:32:26.811827 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:26.814586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:26.828118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.830038 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.830751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.831769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.832361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.833477 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.976541 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:26.977686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:26.994577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.995228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.995676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:26.996410 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:26.996869 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:26.997298 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:27.041327 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:27.062236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-86ad9037-9766-4871-81bc-7c6e869002ab tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1576 microversion: 2.1 time: 0.258711 Sep 02 21:32:27.074532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 540/1114] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:26 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1576 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:27.134544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:27.146701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c8ffaca2-5618-44fe-909a-b5f09d741e13 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1272 microversion: 2.1 time: 0.182501 Sep 02 21:32:27.148629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 575/1115] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:26 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:28.089556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:28.090479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:28.097285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:28.097771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:28.098260 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:28.100983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:28.100983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:28.100983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:28.174546 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:28.175374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:28.186845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:28.187343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:28.189550 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:28.190645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:28.192113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:28.197846 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:28.325687 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:28.335361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9ee1d19c-684a-4e72-a854-1a76f8189999 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1516 microversion: 2.1 time: 0.251223 Sep 02 21:32:28.335868 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 541/1116] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:28 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1516 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:28.396110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:28.403008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-034e6e5f-cdb9-4f0e-9b42-1e26a399f4dd tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.233616 Sep 02 21:32:28.403772 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 576/1117] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:28 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:29.363684 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:29.364898 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:29.375261 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.375673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.376118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.376895 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.377352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.377780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.432646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:29.433694 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:29.445493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.446337 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.447320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.448773 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.449880 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.450875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.595624 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:29.603461 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:29.605827 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-877583fd-0eb1-4bd2-9207-67781fa3a349 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1516 microversion: 2.1 time: 0.249190 Sep 02 21:32:29.606414 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 542/1118] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:29 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:29.674685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:29.678023 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d57e9968-68e1-468f-9d7d-58dbd3be2400 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.252514 Sep 02 21:32:29.679452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 577/1119] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:29 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:29.773524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-45630e67-1d00-418a-8be1-e35ca63fe41a req-50a4a1c9-27ec-4320-b54c-87f0b0af325e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9", "name": "network-vif-unplugged", "status": "completed", "tag": "73eb3820-b2cc-485f-973f-ce9f5381c072"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:29.789850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-45630e67-1d00-418a-8be1-e35ca63fe41a req-50a4a1c9-27ec-4320-b54c-87f0b0af325e service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:29.798380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-45630e67-1d00-418a-8be1-e35ca63fe41a req-50a4a1c9-27ec-4320-b54c-87f0b0af325e service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:29.798380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-45630e67-1d00-418a-8be1-e35ca63fe41a req-50a4a1c9-27ec-4320-b54c-87f0b0af325e service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:29.807822 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.compute.server_external_events [req-45630e67-1d00-418a-8be1-e35ca63fe41a req-50a4a1c9-27ec-4320-b54c-87f0b0af325e service nova] Unable to find a host for instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9. Dropping event network-vif-unplugged {{(pid=121513) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 02 21:32:29.809078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-45630e67-1d00-418a-8be1-e35ca63fe41a req-50a4a1c9-27ec-4320-b54c-87f0b0af325e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.040603 Sep 02 21:32:29.810325 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 543/1120] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 43 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 02 21:32:30.549459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-a94cf0ee-0c7d-41f3-9b44-d19925c7cb12 req-10944e17-23bd-4216-990d-39ece905ef16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eed7906-618e-410e-9c64-a190d673aa75", "tag": "387eb993-9afd-4d27-bbe0-40815077b926"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:30.561952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a94cf0ee-0c7d-41f3-9b44-d19925c7cb12 req-10944e17-23bd-4216-990d-39ece905ef16 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:30.561952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a94cf0ee-0c7d-41f3-9b44-d19925c7cb12 req-10944e17-23bd-4216-990d-39ece905ef16 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:30.562273 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-a94cf0ee-0c7d-41f3-9b44-d19925c7cb12 req-10944e17-23bd-4216-990d-39ece905ef16 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:30.575244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-a94cf0ee-0c7d-41f3-9b44-d19925c7cb12 req-10944e17-23bd-4216-990d-39ece905ef16 service nova] Creating event network-changed:387eb993-9afd-4d27-bbe0-40815077b926 for instance 2eed7906-618e-410e-9c64-a190d673aa75 on hv-cinder-85220 Sep 02 21:32:30.583350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-a94cf0ee-0c7d-41f3-9b44-d19925c7cb12 req-10944e17-23bd-4216-990d-39ece905ef16 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035633 Sep 02 21:32:30.583350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 578/1121] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:30.641061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:30.641802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:30.648587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:30.649078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:30.649515 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:30.650249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:30.650703 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:30.651196 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:30.714542 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:30.715340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:30.727590 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:30.733774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:30.733774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:30.733774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:30.734876 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:30.735509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:30.965835 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:30.966599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:30.976629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6f3e413b-561a-4ed8-9497-f5a27e6ccbca tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.266878 Sep 02 21:32:30.976629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 579/1122] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:30 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:30.985667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:30.985667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:30.989723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:30.990886 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:30.992019 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:30.992928 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:30.993882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:30.994834 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:30.998010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dd4bc8d7-a1c5-403a-89e7-c9654b849c13 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1518 microversion: 2.1 time: 0.365631 Sep 02 21:32:31.009838 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 544/1123] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:30 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1518 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:31.041375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-652d8fa0-2e87-4344-a683-415b27a4875d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/ips" status: 200 len: 150 microversion: 2.1 time: 0.062375 Sep 02 21:32:31.050180 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 580/1124] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:32:30 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/ips => generated 150 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:32.001768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:32.002920 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:32.012491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:32.015151 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:32.034406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:32.034406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:32.034406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:32.034406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:32.035066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:32.035066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:32.037086 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:32.038289 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:32.049463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:32.050134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:32.050789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:32.051583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:32.052434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:32.053233 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:32.276122 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:32.285772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-627089df-7425-4944-b3f7-0915d7a9cd3b tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.284699 Sep 02 21:32:32.286322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 545/1125] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:31 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:32.292105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:32.297652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-256c1283-2c3d-4463-b4f2-9079e369e334 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1518 microversion: 2.1 time: 0.269245 Sep 02 21:32:32.298431 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 581/1126] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:32 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1518 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:33.316222 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:33.316937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:33.322430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:33.323650 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:33.327693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.328268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.328721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.329503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.330067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.330800 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.330933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=4 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:33.333043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.333533 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.334006 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.334950 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:33.335405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:33.336043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:33.559316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:33.563577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:33.573257 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4a7842b1-fbc1-434b-a2a2-67d13e5d7e83 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.264533 Sep 02 21:32:33.575408 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 546/1127] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:33 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:33.576649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-406547b7-52b9-4392-9889-cb73ef67e003 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1518 microversion: 2.1 time: 0.258371 Sep 02 21:32:33.577553 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 582/1128] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:33 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1518 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:34.609310 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:34.610412 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:34.612269 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:34.612893 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:34.620076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:34.620345 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:34.620566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:34.620910 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:34.621249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:34.621508 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:34.621997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:34.622272 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:34.622457 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:34.623335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:34.623608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:34.623951 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:34.878526 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:34.889356 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6085f7e6-0214-43b2-99da-28bd12d02d64 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.280028 Sep 02 21:32:34.890543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 583/1129] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:34 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:34.897919 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:34.909268 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-666ca287-2c41-4dff-a83b-36e00fb48d70 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.304985 Sep 02 21:32:34.909983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 547/1130] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:34 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:35.926933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.927597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:35.930093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:35.934303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:35.935759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:35.935943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:35.936661 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:35.937110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:35.937866 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:35.938336 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:35.938601 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:35.938760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:35.945517 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:35.946075 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:35.946550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:35.947267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:35.947719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:35.948144 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:36.184758 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:36.191110 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:36.193719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-910eb4dd-9fd4-4b6a-bc8f-0868de1cda7d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.270719 Sep 02 21:32:36.194335 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 584/1131] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:36.200077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-708d86b1-887d-41d1-8c6b-177da6daf9f2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.269998 Sep 02 21:32:36.211378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 548/1132] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:35 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:36.347078 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3df6131-18c1-4312-b08b-5d098681ca8a"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:36.348770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:36.356025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:36.358328 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:36.358328 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:36.358700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:36.358934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:36.359243 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:36.460889 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2064270502", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-261479926", "security_groups": [{"name": "tempest-secgroup-smoke-203437446"}], "block_device_mapping_v2": [{"uuid": "4a8ff370-458c-4dea-918f-48dffb0fd6a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "114c3cb0-28e2-4cd4-ac62-ba9797320ab1"}]}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:36.604017 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] validate_networks() for [('114c3cb0-28e2-4cd4-ac62-ba9797320ab1', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:32:37.050088 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:32:37.050701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:32:37.051007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:32:37.051419 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:32:37.051834 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:32:37.063149 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.063680 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.064124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.064850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.065305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.065861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.083869 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Getting quotas for project d0d9b4769b124ec69714a30d02bb8557. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:32:37.088185 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Getting quotas for user e2940758d8424054bf3a68a42b79bb81 and project d0d9b4769b124ec69714a30d02bb8557. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:32:37.338251 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:32:37.340312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4a8ff370-458c-4dea-918f-48dffb0fd6a5',volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:32:37.397831 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a299ebe0-836e-4563-9584-8d59dbfe5ac3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.056088 Sep 02 21:32:37.398449 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 585/1133] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:32:36 2022] POST /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments => generated 194 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:37.404830 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:37.405540 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:37.412346 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.412845 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.413292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.414054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.414517 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.415009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.576878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:37.588611 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-970a4e81-26ce-4561-b3ff-785e144e3497 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.188883 Sep 02 21:32:37.589999 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 586/1134] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:37 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:37.598700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:37.602136 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:37.615192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.615774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.616302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.617078 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.617597 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.618175 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.773020 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:37.788190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-859771cd-79c9-4f9f-860b-149213884c1d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.195380 Sep 02 21:32:37.813543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 587/1135] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:37 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:37.895248 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-45cd7e89-f551-4f39-b83c-f89a99b7444c req-71375205-b62c-46a1-91fe-e9f243a38a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eed7906-618e-410e-9c64-a190d673aa75", "name": "network-vif-plugged", "status": "completed", "tag": "387eb993-9afd-4d27-bbe0-40815077b926"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:37.905579 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-45cd7e89-f551-4f39-b83c-f89a99b7444c req-71375205-b62c-46a1-91fe-e9f243a38a30 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:37.906084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-45cd7e89-f551-4f39-b83c-f89a99b7444c req-71375205-b62c-46a1-91fe-e9f243a38a30 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:37.906512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-45cd7e89-f551-4f39-b83c-f89a99b7444c req-71375205-b62c-46a1-91fe-e9f243a38a30 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:37.918093 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-45cd7e89-f551-4f39-b83c-f89a99b7444c req-71375205-b62c-46a1-91fe-e9f243a38a30 service nova] Creating event network-vif-plugged:387eb993-9afd-4d27-bbe0-40815077b926 for instance 2eed7906-618e-410e-9c64-a190d673aa75 on hv-cinder-85220 Sep 02 21:32:37.923885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-45cd7e89-f551-4f39-b83c-f89a99b7444c req-71375205-b62c-46a1-91fe-e9f243a38a30 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 Sep 02 21:32:37.924667 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 588/1136] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:38.003159 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-3e700d19-472f-4160-ad26-05cd8a8f69ea tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.546577 Sep 02 21:32:38.010605 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 549/1137] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:32:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 1553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:32:38.020662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1a73e24c-5b27-4243-a310-acca19372ad4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:38.021362 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1a73e24c-5b27-4243-a310-acca19372ad4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:38.099489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1a73e24c-5b27-4243-a310-acca19372ad4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:38.111529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1a73e24c-5b27-4243-a310-acca19372ad4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1094 microversion: 2.1 time: 0.093719 Sep 02 21:32:38.111529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 589/1138] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:38 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:38.624494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:38.625573 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:38.634868 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:38.635621 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:38.636300 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:38.637424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:38.638704 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:38.639356 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:38.802559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:38.811739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:38.812364 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:38.813219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-401f8a79-68f3-4d05-b412-aea6d8c952b4 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.195238 Sep 02 21:32:38.815003 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 550/1139] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:38 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:38.821229 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:38.821721 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:38.822202 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:38.822918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:38.823375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:38.823905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:38.984032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:38.994862 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-29107cca-9e8b-418a-ba08-36716e01f098 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.186995 Sep 02 21:32:38.995776 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 590/1140] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:38 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:39.141319 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:39.142050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:39.149427 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:39.149943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:39.150381 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:39.151087 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:39.151541 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:39.151955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:39.227509 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:39.236575 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1f9780f3-1792-4737-9f2e-494e8adc702f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1144 microversion: 2.1 time: 0.101900 Sep 02 21:32:39.237157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 551/1141] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:39 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1144 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:39.839841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:39.841545 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:39.852988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:39.857376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:39.857376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:39.857376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:39.857376 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:39.857839 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.020029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:40.020764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:40.027660 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:40.028157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:40.028863 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.029833 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:40.030726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:40.031351 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.192214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:40.195911 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:40.202419 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-281738f6-a00d-4b02-b923-dd15ecd5e0ff tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.367018 Sep 02 21:32:40.203269 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 591/1142] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:39 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:40.228110 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:40.239103 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ecfe5873-b7a6-46e8-bff1-9315785f1909 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1314 microversion: 2.1 time: 0.223433 Sep 02 21:32:40.240038 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 552/1143] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:40 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:40.260935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:40.261549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:40.268186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:40.268689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:40.269124 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.269861 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:40.270315 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:40.270741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:40.344566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:40.353691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-55ce3563-ccdb-428a-8baf-28ab6e15fa8f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1136 microversion: 2.1 time: 0.096903 Sep 02 21:32:40.354316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 592/1144] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:40 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1136 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:41.227671 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:41.228283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:41.235331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.235764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.236248 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.236913 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.237382 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.237788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.264390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:41.265648 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:41.272764 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.273242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.275821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.275821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.275821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.275821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.446244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:41.454692 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-babab484-8464-4d93-b587-db9e3afc8467 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.230839 Sep 02 21:32:41.455252 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 553/1145] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:41 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:41.460439 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:41.461297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:41.476959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:41.480721 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.481147 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.482213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.483065 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.484759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.484759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.486470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-17972ad9-be21-4326-9e34-9c3e28f0e9e2 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1464 microversion: 2.1 time: 0.226913 Sep 02 21:32:41.487149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 593/1146] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:41 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1464 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:41.541635 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:41.542170 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:41.549547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.550074 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.550509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.551835 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:41.551985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:41.552584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:41.553037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:41.561494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ad46aa2d-bb11-4b11-bbb6-82b506ec8fc1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1192 microversion: 2.1 time: 0.105021 Sep 02 21:32:41.562120 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 554/1147] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:41 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1192 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:41.587823 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:32:42.096050 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-88e44a34-e204-4131-9622-392bcd0f415e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 204 len: 0 microversion: 2.1 time: 0.557791 Sep 02 21:32:42.096552 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 594/1148] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:32:41 2022] DELETE /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:32:42.113924 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:42.115131 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:42.121991 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.122773 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.123250 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.123971 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.124428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.124860 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.262690 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:42.271836 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9f6b0c9c-adbe-4131-b91a-03611c67b934 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1470 microversion: 2.1 time: 0.162408 Sep 02 21:32:42.272429 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 555/1149] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:42 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:42.483789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:42.484673 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:42.491953 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.492509 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.492955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.493668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.494147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.497286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.592199 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:42.592846 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:42.604399 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.604399 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.608190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.609118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:42.610178 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:42.610627 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:42.648564 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:42.657482 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-295e869f-de0b-4bdf-9448-fa307f225273 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.178059 Sep 02 21:32:42.658416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 595/1150] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:42 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:42.679844 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:42.688282 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d3cc84dd-ca0a-4d7e-98ed-52484a8bf26d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1192 microversion: 2.1 time: 0.101549 Sep 02 21:32:42.688852 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 556/1151] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:42 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1192 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:43.297443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:43.298079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:43.304605 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:43.305085 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:43.305520 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:43.306266 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:43.306724 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:43.307311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:43.465601 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:43.475619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ea19f603-2394-4032-93bb-84f5bb3acfdc tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1470 microversion: 2.1 time: 0.182106 Sep 02 21:32:43.476207 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 596/1152] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:43 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1470 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:43.684983 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:43.686358 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:43.698120 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:43.698608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:43.699353 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:43.700138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:43.700596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:43.701011 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:43.726966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:43.727593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:43.736026 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:43.736518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:43.736961 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:43.737692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:43.738615 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:43.739216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:43.829099 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:43.851871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-43773124-8160-4f75-aa7a-445af71b796d tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1192 microversion: 2.1 time: 0.131471 Sep 02 21:32:43.852512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 597/1153] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:43 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1192 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:43.910943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:43.928776 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-19f436d2-09f7-4fc1-a750-1929c4983435 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.247670 Sep 02 21:32:43.932389 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 557/1154] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:43 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:44.500925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:44.501546 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:44.508076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:44.508558 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:44.509002 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:44.509719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:44.510247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:44.510826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:44.647172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:44.655731 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-d3d7d1fd-743f-422f-80fc-04deff0a00c3 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1470 microversion: 2.1 time: 0.159286 Sep 02 21:32:44.656316 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 598/1155] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:44 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:44.877133 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:44.877928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:44.887466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:44.888141 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:44.888699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:44.889411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:44.889915 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:44.890502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:44.954336 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:44.954890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:44.957320 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:44.961593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:44.962117 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:44.962559 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:44.963272 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:44.963730 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:44.964160 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:44.965301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7391c338-c4c9-4484-8632-864675c00191 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1192 microversion: 2.1 time: 0.092137 Sep 02 21:32:44.966400 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 558/1156] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:44 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:45.104668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:45.115044 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-51414184-e49e-4347-a81f-f9d5dbc98392 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.164697 Sep 02 21:32:45.115505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 599/1157] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:44 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:45.680520 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:45.681246 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:45.695812 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:45.703820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-85997f50-6ba0-44dc-b075-c2bc7162d087 req-3e3ee6e5-d059-48f3-9193-2794ddc2a6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eed7906-618e-410e-9c64-a190d673aa75", "name": "network-vif-deleted", "tag": "387eb993-9afd-4d27-bbe0-40815077b926"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:45.708939 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:45.716979 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:45.725378 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:45.727314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:45.727829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:45.737905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-85997f50-6ba0-44dc-b075-c2bc7162d087 req-3e3ee6e5-d059-48f3-9193-2794ddc2a6ec service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:45.742789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-85997f50-6ba0-44dc-b075-c2bc7162d087 req-3e3ee6e5-d059-48f3-9193-2794ddc2a6ec service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:45.743430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-85997f50-6ba0-44dc-b075-c2bc7162d087 req-3e3ee6e5-d059-48f3-9193-2794ddc2a6ec service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:45.798968 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-85997f50-6ba0-44dc-b075-c2bc7162d087 req-3e3ee6e5-d059-48f3-9193-2794ddc2a6ec service nova] Creating event network-vif-deleted:387eb993-9afd-4d27-bbe0-40815077b926 for instance 2eed7906-618e-410e-9c64-a190d673aa75 on hv-cinder-85220 Sep 02 21:32:45.807727 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-85997f50-6ba0-44dc-b075-c2bc7162d087 req-3e3ee6e5-d059-48f3-9193-2794ddc2a6ec service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107272 Sep 02 21:32:45.808622 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 600/1158] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:45.904423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:45.914468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-df4530aa-6553-4bfd-9159-9ccfe745359d tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1428 microversion: 2.1 time: 0.238060 Sep 02 21:32:45.915118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 559/1159] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:45 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1428 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:45.991961 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:45.992869 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:46.002023 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.002754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.003156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.004208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.005217 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.005217 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.018454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-1dffd568-9513-4167-b76f-a3fa00899734 req-cb6dc2df-20e4-4e2c-be14-18aadb36c426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9", "name": "network-vif-plugged", "status": "completed", "tag": "73eb3820-b2cc-485f-973f-ce9f5381c072"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:46.031302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1dffd568-9513-4167-b76f-a3fa00899734 req-cb6dc2df-20e4-4e2c-be14-18aadb36c426 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.032098 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1dffd568-9513-4167-b76f-a3fa00899734 req-cb6dc2df-20e4-4e2c-be14-18aadb36c426 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.033138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1dffd568-9513-4167-b76f-a3fa00899734 req-cb6dc2df-20e4-4e2c-be14-18aadb36c426 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.047442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-1dffd568-9513-4167-b76f-a3fa00899734 req-cb6dc2df-20e4-4e2c-be14-18aadb36c426 service nova] Creating event network-vif-plugged:73eb3820-b2cc-485f-973f-ce9f5381c072 for instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 on hv-cinder-85220 Sep 02 21:32:46.053189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-1dffd568-9513-4167-b76f-a3fa00899734 req-cb6dc2df-20e4-4e2c-be14-18aadb36c426 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043777 Sep 02 21:32:46.054148 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 560/1160] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:46.083249 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:46.098200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9fe77542-6b18-4457-9959-8ffee09408e1 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1210 microversion: 2.1 time: 0.110888 Sep 02 21:32:46.099265 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 601/1161] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:45 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:46.139186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:46.139893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:46.146349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.146839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.147283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.147992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.148453 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.148930 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.171086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:46.390620 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:46.398320 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-40e4f046-f442-4556-96ac-f692e5f49877 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.263900 Sep 02 21:32:46.399188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 561/1162] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:46 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:46.939543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:46.940045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:46.946824 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.947344 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.947793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.948496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.948954 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.949386 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.990349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:46.991104 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:46.991543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:46.991988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lazy-loading 'fault' on Instance uuid 2eed7906-618e-410e-9c64-a190d673aa75 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:47.080189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:47.107682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-dea5583b-95df-4e70-ad5b-7650d8b20a48 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1304 microversion: 2.1 time: 0.170238 Sep 02 21:32:47.107682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 602/1163] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:46 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1304 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:47.127886 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:47.128899 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-dd14b297-003f-46fd-8ffc-ff6d22b4914f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: .version_select at 0x7fb00cf0e160>, body: {"keypair": {"name": "tempest-keypair-1738783074", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA9kraQrYg3OxIP1v6rts4VQEr3oGOHAnkdr5noO1Kjw2jwa5YC2W2l+I76PmoSP7wcNN72Mm3ZHIDhP6dwDyIRyGuZApjAoqgKM0f4fE9/RptdEUvWUJIdFSApoyN3bBA=="}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:47.137454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:47.143594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:47.144314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:47.153598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:47.153992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:47.154440 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:47.158540 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:47.162163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:47.162861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:47.172878 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-dd14b297-003f-46fd-8ffc-ff6d22b4914f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:32:47.182874 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-dd14b297-003f-46fd-8ffc-ff6d22b4914f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for user e343f998e5e34447bd2b5f0a2627bbdf and project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:32:47.367194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:47.376838 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-2a488be1-8e66-4420-aa54-3d87bd917d97 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1277 microversion: 2.1 time: 0.253346 Sep 02 21:32:47.377402 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 562/1164] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:47 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1277 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:47.424145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:47.424145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:47.430086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:47.430561 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:47.431002 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:47.431697 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:47.432148 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:47.432602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:47.469534 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-dd14b297-003f-46fd-8ffc-ff6d22b4914f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.345424 Sep 02 21:32:47.470342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 603/1165] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:32:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:47.579037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:47.586933 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-64d55c15-47e0-42e9-8493-070b1846f66d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.167643 Sep 02 21:32:47.587502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 563/1166] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:47 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:48.135993 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:48.136617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:48.143496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:48.143988 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:48.144467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:48.145176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:48.145631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:48.146089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:48.185167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:48.185167 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:48.186361 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:48.186726 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lazy-loading 'fault' on Instance uuid 2eed7906-618e-410e-9c64-a190d673aa75 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:48.264415 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:48.274430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9256e004-2fe1-4616-bf94-c71893917fe5 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1304 microversion: 2.1 time: 0.143364 Sep 02 21:32:48.276086 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 604/1167] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:48 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:48.409034 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:48.409034 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:48.419254 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:48.419937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:48.420549 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:48.421417 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:48.422279 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:48.422799 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:48.576317 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-d86b0987-9fd2-4118-b485-622b68c86a83 req-c9676af7-a39f-46e8-8d09-27bd9c258e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12699de1-4608-4c0a-a0cc-a0a03ff20558", "tag": "8906f02a-945e-410d-bee4-826c1bd21af4"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:48.586725 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d86b0987-9fd2-4118-b485-622b68c86a83 req-c9676af7-a39f-46e8-8d09-27bd9c258e46 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:48.587210 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d86b0987-9fd2-4118-b485-622b68c86a83 req-c9676af7-a39f-46e8-8d09-27bd9c258e46 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:48.587629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d86b0987-9fd2-4118-b485-622b68c86a83 req-c9676af7-a39f-46e8-8d09-27bd9c258e46 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:48.604968 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:48.615567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-777cf688-fea4-4c3a-a434-b265c969522e tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1277 microversion: 2.1 time: 0.216654 Sep 02 21:32:48.617417 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 564/1168] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:48 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:48.622724 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:48.623621 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:48.629751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:48.630277 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:48.630726 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:48.631445 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:48.631909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:48.632351 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:48.637663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-d86b0987-9fd2-4118-b485-622b68c86a83 req-c9676af7-a39f-46e8-8d09-27bd9c258e46 service nova] Creating event network-changed:8906f02a-945e-410d-bee4-826c1bd21af4 for instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 on hv-cinder-85220 Sep 02 21:32:48.645144 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-d86b0987-9fd2-4118-b485-622b68c86a83 req-c9676af7-a39f-46e8-8d09-27bd9c258e46 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073225 Sep 02 21:32:48.645755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 605/1169] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:32:48.779891 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:48.789372 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ca78d33d-9dc1-405d-a62b-4dfcb8328760 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1574 microversion: 2.1 time: 0.170527 Sep 02 21:32:48.789974 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 565/1170] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:48 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:49.303218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:49.303218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:49.309629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:49.318089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:49.318089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:49.318089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:49.318089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:49.318490 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:49.349569 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:49.350789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:49.351119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:49.351684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lazy-loading 'fault' on Instance uuid 2eed7906-618e-410e-9c64-a190d673aa75 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:32:49.399945 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1ce89c776494d41a3f5cf18076a688c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc1a0a5f86e4a48b2442c9ae0b6457c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:49.412165 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2c05a95b-2b44-4c80-a0a4-b76324eb3b6e tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 200 len: 1304 microversion: 2.1 time: 0.114980 Sep 02 21:32:49.412959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 606/1171] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:49 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:49.643172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:49.644729 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:49.652616 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:49.653428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:49.654439 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:49.655385 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:49.656053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:49.656611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:49.819589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:49.820436 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:49.829492 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:49.830486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:49.833351 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:49.834304 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:49.835064 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:49.835821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:50.303124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:50.312694 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-56bfc9e2-e8aa-4335-a7a6-45195fb2b4f2 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1277 microversion: 2.1 time: 0.673297 Sep 02 21:32:50.328948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 566/1172] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:49 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1277 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:50.328948 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1242795900", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ea88b9b-407d-410e-a71a-923bd00def20"}], "security_groups": [{"name": "tempest-securitygroup--2070010503"}], "key_name": "tempest-keypair-1738783074", "user_data": "}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:50.359764 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:50.370842 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-13b49484-5fdb-4431-afb7-dd1df026bddf tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1561 microversion: 2.1 time: 0.556245 Sep 02 21:32:50.385958 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 607/1173] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:49 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1561 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:50.438333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:50.439131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] [instance: 2eed7906-618e-410e-9c64-a190d673aa75] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:50.445615 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:50.446224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:50.446349 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] validate_networks() for [('4ea88b9b-407d-410e-a71a-923bd00def20', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:32:50.446804 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:50.447656 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:50.448113 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:50.448545 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:50.453427 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:32:50.464090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] HTTP exception thrown: Instance 2eed7906-618e-410e-9c64-a190d673aa75 could not be found. Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Request method failure captured: Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 HTTP/1.1 Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnZiEtADqC5FvJyaz5llOuqo-JACUuyE80TPBVdRYpXM6T2qFGu_fs0HmkbqHAJDF7IgUB_cot7GOFXcHdyiFFIAHXhQWW6wckV25nSCi2v5AR4IH0_UNpA7HFBu3JqBPYYsLhYRrNlNPsOFzeG5eGrW4Ep8DwCkXTvXTZNlvdRM53Y Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: 3bc1a0a5f86e4a48b2442c9ae0b6457c Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-VolumesNegativeTest-580206969 Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:32:50.466348 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/3bc1a0a5f86e4a48b2442c9ae0b6457c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_3bc1a0a5f86e4a48b2442c9ae0b6457c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3bc1a0a5f86e4a48b2442c9ae0b6457c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/3bc1a0a5f86e4a48b2442c9ae0b6457c"}]}] Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-VolumesNegativeTest-580206969 Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: 3bc1a0a5f86e4a48b2442c9ae0b6457c Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-VolumesNegativeTest-580206969 Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-VolumesNegativeTest-580206969-project Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e1ce89c776494d41a3f5cf18076a688c Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-VolumesNegativeTest-580206969-project Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 2eed7906-618e-410e-9c64-a190d673aa75 could not be found. Sep 02 21:32:50.468340 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '2eed7906-618e-410e-9c64-a190d673aa75'} Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eed7906-618e-410e-9c64-a190d673aa75 could not be found. Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:32:50.469156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eed7906-618e-410e-9c64-a190d673aa75 could not be found. Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eed7906-618e-410e-9c64-a190d673aa75 could not be found. Sep 02 21:32:50.470591 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:32:50.471872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] Returning 404 to user: Instance 2eed7906-618e-410e-9c64-a190d673aa75 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:32:50.471872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3ceb9a75-30c1-4684-acc0-6590eecd2d81 tempest-VolumesNegativeTest-580206969 tempest-VolumesNegativeTest-580206969-project] 10.222.0.79 "GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75" status: 404 len: 111 microversion: 2.1 time: 0.034051 Sep 02 21:32:50.471872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 608/1174] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:50 2022] GET /compute/v2.1/servers/2eed7906-618e-410e-9c64-a190d673aa75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:32:50.878708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:32:50.879302 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:32:50.879594 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:32:50.880062 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:32:50.880474 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:32:50.890536 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:50.891480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:50.891610 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:50.892374 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:50.892777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:50.893207 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:50.914407 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:32:50.918692 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for user e343f998e5e34447bd2b5f0a2627bbdf and project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:32:50.931763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:32:50.935410 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:32:51.120686 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-df4c0d71-cb14-4723-9d9f-3770f2da9014 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.806137 Sep 02 21:32:51.123963 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 567/1175] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:32:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:32:51.136083 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-268c7e09-5ae7-458b-bb63-f364ef59a1e3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:51.136719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-268c7e09-5ae7-458b-bb63-f364ef59a1e3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:51.216307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-268c7e09-5ae7-458b-bb63-f364ef59a1e3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:51.227814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-268c7e09-5ae7-458b-bb63-f364ef59a1e3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1242 microversion: 2.1 time: 0.095016 Sep 02 21:32:51.229603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 609/1176] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:51 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:51.338621 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:51.339252 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:51.353680 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:51.354567 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:51.355189 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:51.356808 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:51.357899 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:51.358769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:51.600321 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:51.609517 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-06dbd4bf-4aa6-436c-8441-e2bf18c2b081 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.276791 Sep 02 21:32:51.610145 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 568/1177] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:51 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:52.259056 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7ed3d5dc-ce6b-4e3d-b468-993d1fc7f0df tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:52.274069 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7ed3d5dc-ce6b-4e3d-b468-993d1fc7f0df tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:52.323839 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7ed3d5dc-ce6b-4e3d-b468-993d1fc7f0df tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:52.332338 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7ed3d5dc-ce6b-4e3d-b468-993d1fc7f0df tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1242 microversion: 2.1 time: 0.078120 Sep 02 21:32:52.332919 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 610/1178] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:52 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:52.634466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:52.635086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:52.642178 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:52.642777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:52.643269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:52.643967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:52.644419 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:52.644845 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:52.786869 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:52.799633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e146c066-623f-4012-b980-3b55f35dcf0b tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.164748 Sep 02 21:32:52.799633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 569/1179] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:52 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:53.357585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:53.358380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:53.374467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:53.375045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:53.375526 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:53.376241 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:53.377470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:53.377470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:53.444432 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:53.452927 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-43ef47f9-1b32-4757-be01-b5ed606e186f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1294 microversion: 2.1 time: 0.100378 Sep 02 21:32:53.453480 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 611/1180] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:53 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1294 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:53.820818 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:53.821444 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:53.828641 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:53.829132 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:53.829572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:53.830564 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:53.830808 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:53.831267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:54.019505 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:54.027815 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-35582a74-bbc2-49b9-adba-26a065dbb893 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.211260 Sep 02 21:32:54.028628 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 570/1181] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:53 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:54.478116 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:54.478890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:54.486757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:54.492580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:54.492580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:54.492580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:54.492580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:54.493315 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:54.589942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:54.602271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-16972bbc-f898-4d9f-9739-b2ab45d1aeae tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1302 microversion: 2.1 time: 0.129217 Sep 02 21:32:54.602867 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 612/1182] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:54 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1302 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:55.060243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:55.061193 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:55.067761 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:55.068573 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:55.069190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:55.070126 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:55.070763 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:55.071390 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:55.323459 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:55.333223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-409283b3-9579-4180-8c5f-f861b5bd5980 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.278415 Sep 02 21:32:55.334359 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 571/1183] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:55 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:55.634246 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:55.635097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:55.650186 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:55.651271 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:55.651841 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:55.653089 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:55.653738 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:55.654304 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:55.914786 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:55.925066 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6c59b369-6385-4f2b-a200-540728595afc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.301468 Sep 02 21:32:55.928789 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 613/1184] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:55 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:32:56.359556 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:56.360386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:56.368385 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:56.373060 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:56.373060 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:56.373060 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:56.373060 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:56.373464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:56.589404 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:56.604755 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0ffadedf-2bbf-4fe3-86ea-e5f3f4cd46a4 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.250617 Sep 02 21:32:56.605334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 572/1185] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:56 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:56.740009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-5cf7fccc-2816-4bea-896c-0d530fd8eaee req-4dd8427e-d717-48a9-8bc2-dfae327f4809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a250bcd-5a3f-468b-a31e-2c4f4c20f895", "tag": "401f227e-eeb5-44a1-a075-c96f1fccf6fe"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:32:56.750910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5cf7fccc-2816-4bea-896c-0d530fd8eaee req-4dd8427e-d717-48a9-8bc2-dfae327f4809 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:56.751384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5cf7fccc-2816-4bea-896c-0d530fd8eaee req-4dd8427e-d717-48a9-8bc2-dfae327f4809 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:56.751806 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5cf7fccc-2816-4bea-896c-0d530fd8eaee req-4dd8427e-d717-48a9-8bc2-dfae327f4809 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:56.763456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-5cf7fccc-2816-4bea-896c-0d530fd8eaee req-4dd8427e-d717-48a9-8bc2-dfae327f4809 service nova] Creating event network-changed:401f227e-eeb5-44a1-a075-c96f1fccf6fe for instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 on hv-cinder-85220 Sep 02 21:32:56.773096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-5cf7fccc-2816-4bea-896c-0d530fd8eaee req-4dd8427e-d717-48a9-8bc2-dfae327f4809 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037158 Sep 02 21:32:56.773698 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 614/1186] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:32:56.951454 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:56.952345 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:56.959888 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:56.960510 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:56.961028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:56.961894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:56.962595 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:56.963107 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:57.201239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:57.211176 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ef46df47-887f-416e-ba55-5778db3bf224 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.263089 Sep 02 21:32:57.211176 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 573/1187] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:56 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:57.641346 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:57.642100 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:57.649224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:57.650132 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:57.650606 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:57.651281 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:57.651751 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:57.652156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:57.901222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:57.910765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-db036cd7-dac4-4e2a-aead-f5a6df408812 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.276695 Sep 02 21:32:57.911703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 615/1188] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:57 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:58.234193 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:58.234797 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:58.241777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:58.242276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:58.242718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:58.243423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:58.243881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:58.244306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:58.401957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:58.410049 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-af955513-989e-4bea-97a0-42ba57245b07 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.180095 Sep 02 21:32:58.410619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 574/1189] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:58 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:58.936649 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:58.937395 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:58.944458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:58.945080 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:58.945391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:58.946131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:58.947769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:58.947769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:59.092675 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:59.100971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4d45e8a7-f75e-41fe-b75b-0c3b73d543f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.169238 Sep 02 21:32:59.101548 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 616/1190] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:58 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:32:59.433285 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:32:59.434734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:32:59.442460 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:59.443284 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:59.443936 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:59.444840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:32:59.445308 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:32:59.445959 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:32:59.593751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:32:59.601611 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-dfdb95c7-0488-4e4e-ab4c-d4ac583af3d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.172775 Sep 02 21:32:59.602236 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 575/1191] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:32:59 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:00.125318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:00.125917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:00.133374 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:00.140593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:00.140593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:00.140593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:00.140593 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:00.141025 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:00.279185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:00.287184 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5d47b34d-f634-4705-a574-f376f9d42847 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.166456 Sep 02 21:33:00.287750 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 617/1192] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:00 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:00.625744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:00.626524 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:00.633305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:00.634624 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:00.634624 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:00.635063 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:00.635513 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:00.635934 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:00.775706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:00.784552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d1e1f1d1-59d7-4f23-86ff-51dd5c629b90 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.163476 Sep 02 21:33:00.785120 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 576/1193] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:00 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:01.311713 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:01.312361 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:01.319181 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:01.320848 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:01.320848 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:01.320848 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:01.321240 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:01.321668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:01.454877 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:01.462921 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0600272f-781b-4550-a200-a753422b62a9 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.155925 Sep 02 21:33:01.463480 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 618/1194] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:01 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:01.809093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:01.810464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:01.812467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:01.813136 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:01.819491 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:01.819981 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:01.820428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:01.821137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:01.821591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:01.822047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:01.962195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:01.970227 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e380175d-0237-4c09-a806-f68b1e291658 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.165313 Sep 02 21:33:01.970797 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 577/1195] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:01 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:02.485823 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:02.490929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:02.490929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=10 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:02.494242 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:02.494733 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:02.495182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:02.495875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:02.496360 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:02.496910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:02.629555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:02.639716 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-b65f47c2-56ca-45b7-ae31-2267401b31ca tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.157704 Sep 02 21:33:02.640575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 619/1196] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:02 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:02.992880 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:02.993535 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:03.000765 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:03.001255 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:03.001730 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:03.002458 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:03.002916 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:03.003346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:03.139658 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:03.143118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=100 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:03.147607 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5969e348-ffcb-4845-a5db-70a2bc57f0a1 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.158648 Sep 02 21:33:03.148186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 578/1197] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:02 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:03.663506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:03.664131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:03.666743 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:03.672856 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:03.673283 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:03.673688 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:03.674445 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:03.674910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:03.675343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:03.818579 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:03.827475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a28a2969-ccb6-440e-8e8b-242ae19c6b44 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.168225 Sep 02 21:33:03.828061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 620/1198] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:03 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:04.172008 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:04.172771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:04.179881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:04.183759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:04.183759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:04.183759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:04.183759 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:04.184410 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:04.328456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:04.337305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a0e527cc-f930-403e-91fe-e3960b5e8f4d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.169014 Sep 02 21:33:04.337954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 579/1199] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:04 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:04.851329 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:04.851952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:04.859826 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:04.860319 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:04.860767 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:04.861729 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:04.862230 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:04.862652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:05.005902 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:05.014038 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-8fab73d1-1c48-4e7a-af2e-96ee73a79c47 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.166476 Sep 02 21:33:05.014718 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 621/1200] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:04 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:05.360286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:05.361719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:05.368742 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:05.369233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:05.369675 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:05.370463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:05.370872 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:05.371303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:05.503677 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:05.511428 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-bd805e0b-1b62-4ae2-acfd-024e8a387f97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.155242 Sep 02 21:33:05.511988 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 580/1201] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:05 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:06.036984 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:06.037606 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:06.044350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:06.044920 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:06.045575 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:06.046313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:06.046766 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:06.047214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:06.199031 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:06.207683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-34295b70-4bb4-4606-8782-eb420c83cbad tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.174591 Sep 02 21:33:06.209765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 622/1202] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:06 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:06.535583 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:06.536198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:06.538559 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:06.543273 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:06.543754 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:06.544187 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:06.544883 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:06.545331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:06.545952 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:06.694764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:06.705595 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d9bbc8b9-6c99-478a-af86-5d8464526efa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.173622 Sep 02 21:33:06.706443 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 581/1203] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:06 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:07.232221 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:07.233392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:07.240927 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:07.241408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:07.241865 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:07.242563 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:07.243041 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:07.243460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:07.380438 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:07.388324 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2d2bd79e-4b0e-4167-893d-468a3f3145f7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.160088 Sep 02 21:33:07.388903 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 623/1204] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:07 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:07.565439 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-1e48c70a-7d31-41a6-88b0-bda00105d33f req-4a89a380-f049-43ac-bed5-63a1078da624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12699de1-4608-4c0a-a0cc-a0a03ff20558", "name": "network-vif-plugged", "status": "completed", "tag": "8906f02a-945e-410d-bee4-826c1bd21af4"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:33:07.575810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1e48c70a-7d31-41a6-88b0-bda00105d33f req-4a89a380-f049-43ac-bed5-63a1078da624 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:07.576292 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1e48c70a-7d31-41a6-88b0-bda00105d33f req-4a89a380-f049-43ac-bed5-63a1078da624 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:07.576915 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1e48c70a-7d31-41a6-88b0-bda00105d33f req-4a89a380-f049-43ac-bed5-63a1078da624 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:07.588734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-1e48c70a-7d31-41a6-88b0-bda00105d33f req-4a89a380-f049-43ac-bed5-63a1078da624 service nova] Creating event network-vif-plugged:8906f02a-945e-410d-bee4-826c1bd21af4 for instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 on hv-cinder-85220 Sep 02 21:33:07.594859 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-1e48c70a-7d31-41a6-88b0-bda00105d33f req-4a89a380-f049-43ac-bed5-63a1078da624 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Sep 02 21:33:07.595667 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 582/1205] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:33:07.732662 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:07.734608 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:07.745690 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:07.746636 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:07.747436 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:07.751199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:07.752183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:07.752979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:07.939774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:07.948182 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-2e266e5a-30a2-4b22-9b5c-ef99059c7a23 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.222797 Sep 02 21:33:07.948763 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 624/1206] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:07 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:08.413280 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:08.414029 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:08.420744 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:08.422762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:08.422762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:08.422762 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:08.423128 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:08.423373 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:08.563123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:08.571276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0e0c47b5-1f39-4ae5-a5e5-12da2d014655 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.162663 Sep 02 21:33:08.571950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 583/1207] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:08 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:08.972257 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:08.973039 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:08.979617 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:08.980098 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:08.980550 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:08.981234 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:08.981683 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:08.982131 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:09.117084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:09.125129 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-cfbaefa0-85a2-4360-bd50-a14b277466c9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.156944 Sep 02 21:33:09.126357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 625/1208] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:08 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:09.595864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:09.596518 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:09.603129 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:09.603591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:09.604026 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:09.604723 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:09.605175 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:09.605592 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:09.672719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-b1825e18-c75c-49a7-aba5-e14a1be32293 req-77e0fd7c-efcf-4bb2-8d2d-ce1edfadff70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a250bcd-5a3f-468b-a31e-2c4f4c20f895", "name": "network-vif-plugged", "status": "completed", "tag": "401f227e-eeb5-44a1-a075-c96f1fccf6fe"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:33:09.683231 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-b1825e18-c75c-49a7-aba5-e14a1be32293 req-77e0fd7c-efcf-4bb2-8d2d-ce1edfadff70 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:09.683715 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-b1825e18-c75c-49a7-aba5-e14a1be32293 req-77e0fd7c-efcf-4bb2-8d2d-ce1edfadff70 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:09.684146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-b1825e18-c75c-49a7-aba5-e14a1be32293 req-77e0fd7c-efcf-4bb2-8d2d-ce1edfadff70 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:09.699058 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-b1825e18-c75c-49a7-aba5-e14a1be32293 req-77e0fd7c-efcf-4bb2-8d2d-ce1edfadff70 service nova] Creating event network-vif-plugged:401f227e-eeb5-44a1-a075-c96f1fccf6fe for instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 on hv-cinder-85220 Sep 02 21:33:09.704461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-b1825e18-c75c-49a7-aba5-e14a1be32293 req-77e0fd7c-efcf-4bb2-8d2d-ce1edfadff70 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035575 Sep 02 21:33:09.705780 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 626/1209] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:33:09.755834 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:09.765182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-703bc546-f168-4c34-8240-12f1dfd914fb tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1265 microversion: 2.1 time: 0.173644 Sep 02 21:33:09.765450 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 584/1210] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:09 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:10.150726 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:10.151519 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:10.158686 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:10.159176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:10.159612 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:10.160324 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:10.160785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:10.161214 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:10.308685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:10.318820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-662970d4-67ef-4f65-baef-2366953609b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.173087 Sep 02 21:33:10.319413 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 627/1211] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:10 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:10.788849 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:10.789601 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:10.796442 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:10.796932 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:10.797365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:10.798089 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:10.799435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:10.800142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:10.956921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:10.965190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b4e6a3b5-7912-4e70-8f77-e0eef7d1c668 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1453 microversion: 2.1 time: 0.180273 Sep 02 21:33:10.966598 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 585/1212] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:10 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1453 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:10.992694 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:10.993461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:11.001062 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:11.002435 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:11.003102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:11.003833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:11.004294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:11.004728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:11.153963 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:11.158476 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=100 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:33:11.163719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bfb80c1f-a592-4fba-a6c4-aae9b15f1f1a tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1453 microversion: 2.1 time: 0.174844 Sep 02 21:33:11.171223 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 628/1213] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:10 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:11.346127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:11.346127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:11.363969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:11.366938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:11.366938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:11.366938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:11.366938 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:11.367297 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:11.515834 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:11.523747 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-c70fed41-0c0c-459f-9592-2f335e4234b3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.183696 Sep 02 21:33:11.524315 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 586/1214] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:11 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:12.548562 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:12.549262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:12.556793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:12.557277 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:12.557711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:12.558595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:12.559043 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:12.559505 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:12.788146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:12.801401 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-87314438-ca77-4a0e-b176-89cc1c70fdd0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1368 microversion: 2.1 time: 0.257008 Sep 02 21:33:12.801882 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 629/1215] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:12 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1368 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:13.827949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:13.828753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:13.840696 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:13.841467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:13.842021 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:13.843548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:13.843548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:13.843843 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:13.858754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-7d2aba89-8c1b-4c85-99e5-5874a8bbc8b4 req-e1b81c07-5c02-4831-9bb4-55bca0da0f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12699de1-4608-4c0a-a0cc-a0a03ff20558", "tag": "8906f02a-945e-410d-bee4-826c1bd21af4"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:33:13.870236 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-7d2aba89-8c1b-4c85-99e5-5874a8bbc8b4 req-e1b81c07-5c02-4831-9bb4-55bca0da0f24 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:13.878671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-7d2aba89-8c1b-4c85-99e5-5874a8bbc8b4 req-e1b81c07-5c02-4831-9bb4-55bca0da0f24 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:13.878671 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-7d2aba89-8c1b-4c85-99e5-5874a8bbc8b4 req-e1b81c07-5c02-4831-9bb4-55bca0da0f24 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:13.883780 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-7d2aba89-8c1b-4c85-99e5-5874a8bbc8b4 req-e1b81c07-5c02-4831-9bb4-55bca0da0f24 service nova] Creating event network-changed:8906f02a-945e-410d-bee4-826c1bd21af4 for instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 on hv-cinder-85220 Sep 02 21:33:13.894142 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-7d2aba89-8c1b-4c85-99e5-5874a8bbc8b4 req-e1b81c07-5c02-4831-9bb4-55bca0da0f24 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038619 Sep 02 21:33:13.895501 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 630/1216] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:33:14.002168 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:33:14.010392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-391f0085-9826-45b8-a53c-5498fe8853ad tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1558 microversion: 2.1 time: 0.186922 Sep 02 21:33:14.010970 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 587/1217] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:33:13 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1558 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:33:14.035511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:33:14.036107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:33:14.042646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:14.044289 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:14.044289 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:14.044595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:14.044840 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:14.045267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:14.137156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-35eb9bb4-2457-4d04-a1b1-cdc946950065 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107004 Sep 02 21:33:14.137785 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 631/1218] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Sep 2 21:33:14 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:33:15.239134 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-8d15cef3-d6e2-4f1f-a132-fdf4618ef597 req-efda18b0-d182-41f2-8ccd-54f1e61bb9d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a250bcd-5a3f-468b-a31e-2c4f4c20f895", "tag": "401f227e-eeb5-44a1-a075-c96f1fccf6fe"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:33:15.251777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8d15cef3-d6e2-4f1f-a132-fdf4618ef597 req-efda18b0-d182-41f2-8ccd-54f1e61bb9d3 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:33:15.251777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8d15cef3-d6e2-4f1f-a132-fdf4618ef597 req-efda18b0-d182-41f2-8ccd-54f1e61bb9d3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:33:15.251777 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-8d15cef3-d6e2-4f1f-a132-fdf4618ef597 req-efda18b0-d182-41f2-8ccd-54f1e61bb9d3 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:33:15.263717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-8d15cef3-d6e2-4f1f-a132-fdf4618ef597 req-efda18b0-d182-41f2-8ccd-54f1e61bb9d3 service nova] Creating event network-changed:401f227e-eeb5-44a1-a075-c96f1fccf6fe for instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 on hv-cinder-85220 Sep 02 21:33:15.272400 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-8d15cef3-d6e2-4f1f-a132-fdf4618ef597 req-efda18b0-d182-41f2-8ccd-54f1e61bb9d3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037812 Sep 02 21:33:15.273206 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 588/1219] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:10.648985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=23 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:10.649871 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=12 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:10.654822 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:10.655313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:10.661434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:10.662909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:10.662909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:10.663138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:10.663498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:10.663922 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:10.688663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-68da71be-ad9a-43ea-b52d-2477f4957e96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895/ips" status: 200 len: 149 microversion: 2.1 time: 0.041345 Sep 02 21:34:10.689311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 632/1220] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:34:10 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:10.699676 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=15 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:10.700554 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=52 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:10.705467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3df6131-18c1-4312-b08b-5d098681ca8a"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:10.708070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:10.715322 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:10.715786 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:10.716337 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:10.717100 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:10.717553 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:10.718022 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:10.803377 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Invalid volume: volume e3df6131-18c1-4312-b08b-5d098681ca8a is already attached to instances: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: POST /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895/os-volume_attachments HTTP/1.1 Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 74 Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:34:10.805121 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {"volumeAttachment": {"volumeId": "e3df6131-18c1-4312-b08b-5d098681ca8a"}} Sep 02 21:34:10.806722 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Invalid volume: volume e3df6131-18c1-4312-b08b-5d098681ca8a is already attached to instances: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'server_id': '2a250bcd-5a3f-468b-a31e-2c4f4c20f895', 'body': {'volumeAttachment': {'volumeId': 'e3df6131-18c1-4312-b08b-5d098681ca8a'}}} Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e3df6131-18c1-4312-b08b-5d098681ca8a is already attached to instances: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:10.807572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e3df6131-18c1-4312-b08b-5d098681ca8a is already attached to instances: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:10.809245 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:34:10.811295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:34:10.811295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:34:10.811295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:34:10.811295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e3df6131-18c1-4312-b08b-5d098681ca8a is already attached to instances: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 Sep 02 21:34:10.811295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:10.811295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 400 to user: Invalid volume: volume e3df6131-18c1-4312-b08b-5d098681ca8a is already attached to instances: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:34:10.811295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f2572e0c-016b-4787-8174-124fe0939b86 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109217 Sep 02 21:34:10.811295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 589/1221] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:34:10 2022] POST /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:34:10.815996 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:10.816657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:10.824547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:10.825045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:10.825489 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:10.826234 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:10.826693 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:10.827127 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:10.856577 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:34:11.159681 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-348ce5c6-0edf-4b38-aca4-31a8fa0eb690 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 204 len: 0 microversion: 2.1 time: 0.347396 Sep 02 21:34:11.160306 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 633/1222] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:34:10 2022] DELETE /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:34:11.169545 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:11.170314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:11.177072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:11.177621 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:11.179186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:11.179890 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:11.180343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:11.180765 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:11.318168 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:11.326714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a914885a-1168-4806-8333-88e2d88bc9dd tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1682 microversion: 2.1 time: 0.161978 Sep 02 21:34:11.327287 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 590/1223] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:11 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:12.353539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:12.354286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:12.362132 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:12.362734 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:12.363071 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:12.363780 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:12.364239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:12.364668 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:12.523403 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:12.531532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e11db08b-f664-428a-8517-cd3a1e3a6883 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1682 microversion: 2.1 time: 0.182379 Sep 02 21:34:12.532102 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 634/1224] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:12 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:13.556464 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:13.557068 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:13.563814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:13.564295 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:13.564729 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:13.565435 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:13.565914 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:13.566338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:13.710396 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:13.721054 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fca2bea4-cf65-4288-a517-3ddff75e1900 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1682 microversion: 2.1 time: 0.168400 Sep 02 21:34:13.736036 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 591/1225] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:13 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:14.758052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:14.758674 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:14.766364 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:14.766849 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:14.767284 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:14.768189 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:14.768646 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:14.769070 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:14.910930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:14.919700 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-335d0b7c-a160-4d35-af0d-1175f8832954 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1682 microversion: 2.1 time: 0.165459 Sep 02 21:34:14.920275 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 635/1226] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:14 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:15.944889 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:15.945436 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:15.953526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:15.954225 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:15.954807 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:15.955606 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:15.956072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:15.956503 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:16.032507 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:16.041078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-90038dba-ff37-4f57-90fd-fe6e777ead25 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1614 microversion: 2.1 time: 0.100210 Sep 02 21:34:16.050432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 592/1227] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:15 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1614 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:16.212638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-cca95879-42b7-48d3-ad03-08e9ddb02f32 req-8808b557-5bcf-41fc-a9da-be9ee6aeb956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a250bcd-5a3f-468b-a31e-2c4f4c20f895", "name": "network-vif-deleted", "tag": "401f227e-eeb5-44a1-a075-c96f1fccf6fe"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:16.224449 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-cca95879-42b7-48d3-ad03-08e9ddb02f32 req-8808b557-5bcf-41fc-a9da-be9ee6aeb956 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:16.225491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-cca95879-42b7-48d3-ad03-08e9ddb02f32 req-8808b557-5bcf-41fc-a9da-be9ee6aeb956 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:16.226034 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-cca95879-42b7-48d3-ad03-08e9ddb02f32 req-8808b557-5bcf-41fc-a9da-be9ee6aeb956 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:16.239350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-cca95879-42b7-48d3-ad03-08e9ddb02f32 req-8808b557-5bcf-41fc-a9da-be9ee6aeb956 service nova] Creating event network-vif-deleted:401f227e-eeb5-44a1-a075-c96f1fccf6fe for instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 on hv-cinder-85220 Sep 02 21:34:16.245092 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-cca95879-42b7-48d3-ad03-08e9ddb02f32 req-8808b557-5bcf-41fc-a9da-be9ee6aeb956 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.226436 Sep 02 21:34:16.245786 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 636/1228] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:17.065211 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:17.065921 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:17.073504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:17.074050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:17.075018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:17.075862 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:17.076333 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:17.076769 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:17.132806 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:17.133686 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:17.135568 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:17.135568 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lazy-loading 'fault' on Instance uuid 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:34:17.216126 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:17.227073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a3bee1fe-b369-44e2-9373-cec6bc8f6730 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 200 len: 1332 microversion: 2.1 time: 0.165666 Sep 02 21:34:17.228307 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 593/1229] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:17 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 1332 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:18.266283 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:18.274555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:18.274555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:18.274555 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:18.274970 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:18.275518 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:18.275969 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:18.276399 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:18.292010 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 HTTP/1.1 Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:34:18.294971 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:34:18.296603 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '2a250bcd-5a3f-468b-a31e-2c4f4c20f895'} Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:34:18.297465 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:34:18.299055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:18.300589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:34:18.300589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3e164b63-f89b-4519-aab8-ce7d497e528e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 404 len: 111 microversion: 2.1 time: 0.035438 Sep 02 21:34:18.300589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 637/1230] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:18 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:34:18.306756 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6f7f4ba5-9c62-4920-9133-d6f5d5bc57b4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '.version_select at 0x7fb00cca8e50>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:18.422258 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6f7f4ba5-9c62-4920-9133-d6f5d5bc57b4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738783074" status: 202 len: 0 microversion: 2.1 time: 0.120031 Sep 02 21:34:18.422939 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 594/1231] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Sep 2 21:34:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1738783074 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:34:19.413697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:19.418394 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:19.421993 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:19.422571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:19.423054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:19.423807 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:19.424303 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:19.424923 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:19.521968 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lazy-loading 'services' on Instance uuid 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:34:19.741989 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-042ce4d5-c7b6-477a-8566-d70b8720fb9d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments/e3df6131-18c1-4312-b08b-5d098681ca8a" status: 202 len: 0 microversion: 2.1 time: 0.332464 Sep 02 21:34:19.742707 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 638/1232] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:34:19 2022] DELETE /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments/e3df6131-18c1-4312-b08b-5d098681ca8a => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:34:19.753582 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:19.758290 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:19.765259 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:19.765676 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:19.766142 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:19.766857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:19.767311 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:19.768075 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:19.802181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-21a2ece4-906f-45c0-a4e4-987daa00385d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052667 Sep 02 21:34:19.802809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 595/1233] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:34:19 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:20.816998 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:20.819317 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:20.826336 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:20.831216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:20.831216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:20.831216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:20.831216 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:20.831935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:20.866916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-26fe049a-86f7-4c42-beba-138503a0641a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054956 Sep 02 21:34:20.867599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 639/1234] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:34:20 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:21.880870 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:21.883149 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:21.890338 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:21.890820 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:21.891255 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:21.892108 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:21.892570 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:21.893075 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:21.926771 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-387ae039-2f0a-4791-bb39-a4ce4ec9162c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050150 Sep 02 21:34:21.927804 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 596/1235] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:34:21 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:34:22.002183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:22.002957 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:22.009294 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.009917 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.010554 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:22.011765 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.012228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.012657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:22.040585 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:34:22.122955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:22.124243 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:22.131702 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.132426 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.133040 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:22.134035 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.157070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.157070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:22.165260 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:34:22.783922 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-000f8b60-9069-4c75-999b-aa16eed9a3c7 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "DELETE /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 204 len: 0 microversion: 2.1 time: 0.664650 Sep 02 21:34:22.795562 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-6f263951-e6ca-4d07-82ec-bf89b8504df8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 204 len: 0 microversion: 2.1 time: 0.786323 Sep 02 21:34:22.795923 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 597/1236] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:34:22 2022] DELETE /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:34:22.796061 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 640/1237] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:34:21 2022] DELETE /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:34:22.800105 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:22.801015 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:22.802590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-04545c27-e7d1-4fec-88c3-86e4d51c2bcf req-f642d90d-d98c-4bda-a965-92b1db450b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9", "tag": "73eb3820-b2cc-485f-973f-ce9f5381c072"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:22.812952 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.813774 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.814463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:22.815437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.815643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-04545c27-e7d1-4fec-88c3-86e4d51c2bcf req-f642d90d-d98c-4bda-a965-92b1db450b00 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.816177 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-04545c27-e7d1-4fec-88c3-86e4d51c2bcf req-f642d90d-d98c-4bda-a965-92b1db450b00 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.816512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.817229 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-04545c27-e7d1-4fec-88c3-86e4d51c2bcf req-f642d90d-d98c-4bda-a965-92b1db450b00 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:22.817635 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:22.832094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-04545c27-e7d1-4fec-88c3-86e4d51c2bcf req-f642d90d-d98c-4bda-a965-92b1db450b00 service nova] Creating event network-changed:73eb3820-b2cc-485f-973f-ce9f5381c072 for instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 on hv-cinder-85220 Sep 02 21:34:22.837701 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-04545c27-e7d1-4fec-88c3-86e4d51c2bcf req-f642d90d-d98c-4bda-a965-92b1db450b00 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040082 Sep 02 21:34:22.843809 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 598/1238] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:22.853072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:22.855365 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:22.865348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.869124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.869778 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:22.870760 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:22.871406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:22.872413 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:23.048739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:23.066999 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-39146b8d-0a7b-43fd-a7c5-b0c46627beec tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.272988 Sep 02 21:34:23.068267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 641/1239] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:22 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:23.085085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:23.094504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-bd5639a0-2f8e-4d1d-9020-87227c9d06aa tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1682 microversion: 2.1 time: 0.247084 Sep 02 21:34:23.095081 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 599/1240] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:22 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1682 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:24.092764 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:24.093638 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:24.100411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:24.100775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:24.101240 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:24.101933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:24.102388 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:24.102806 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:24.119675 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:24.121025 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:24.129659 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:24.130448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:24.130953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:24.131745 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:24.132272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:24.132788 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:24.339843 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:24.348592 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-605fb737-e895-4751-98d8-6e509223a79d tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.260042 Sep 02 21:34:24.349172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 642/1241] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:24 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:24.373696 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:24.379593 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-948810fd-507a-4454-9980-5a367f9a5fc2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1682 microversion: 2.1 time: 0.264086 Sep 02 21:34:24.380348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 600/1242] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:24 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:34:25.375703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:25.376315 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:25.382972 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:25.383466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:25.383904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:25.384742 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:25.385192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:25.385583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:25.407134 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:25.407824 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:25.414204 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:25.414686 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:25.415416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:25.415804 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:25.416251 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:25.416676 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:25.594398 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:25.602606 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-150deec9-cbb9-48e1-94d4-20714f73dc59 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.232302 Sep 02 21:34:25.603192 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 643/1243] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:25 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:25.606673 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:25.615386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4fb7bfc1-7c4e-4e18-9cc8-07920fb319d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1682 microversion: 2.1 time: 0.212243 Sep 02 21:34:25.615963 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 601/1244] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:25 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1682 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:34:26.628536 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:26.629185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:26.640693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:26.641303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:26.645684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:26.646548 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:26.649468 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:26.650463 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:26.651921 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:26.652381 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:26.658949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:26.659879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:26.660543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:26.661493 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:26.662196 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:26.662963 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:26.981224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:26.990573 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-1af1f963-b88d-4fdc-92cd-d2672f5aaaa1 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1567 microversion: 2.1 time: 0.366567 Sep 02 21:34:26.991256 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 644/1245] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:26 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1567 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:27.018416 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:27.024532 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-42823345-a35c-434d-9d92-c309bf1a5f81 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1682 microversion: 2.1 time: 0.388328 Sep 02 21:34:27.025566 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 602/1246] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:26 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1682 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:34:27.610292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-d1697903-7a70-4af1-a3d1-3cb9cebaf54b req-c46d2da1-4d93-4aeb-b4ff-32d35fff3c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9", "name": "network-vif-deleted", "tag": "73eb3820-b2cc-485f-973f-ce9f5381c072"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:27.620632 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d1697903-7a70-4af1-a3d1-3cb9cebaf54b req-c46d2da1-4d93-4aeb-b4ff-32d35fff3c50 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:27.621174 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d1697903-7a70-4af1-a3d1-3cb9cebaf54b req-c46d2da1-4d93-4aeb-b4ff-32d35fff3c50 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:27.621609 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d1697903-7a70-4af1-a3d1-3cb9cebaf54b req-c46d2da1-4d93-4aeb-b4ff-32d35fff3c50 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:27.637290 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-d1697903-7a70-4af1-a3d1-3cb9cebaf54b req-c46d2da1-4d93-4aeb-b4ff-32d35fff3c50 service nova] Creating event network-vif-deleted:73eb3820-b2cc-485f-973f-ce9f5381c072 for instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 on hv-cinder-85220 Sep 02 21:34:27.644253 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-d1697903-7a70-4af1-a3d1-3cb9cebaf54b req-c46d2da1-4d93-4aeb-b4ff-32d35fff3c50 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037801 Sep 02 21:34:27.645991 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 645/1247] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:28.021461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:28.022541 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:28.034452 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:28.035375 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:28.036008 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:28.037516 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:28.038423 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:28.039438 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:28.156782 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-e265fd69-2708-4e8f-ab0f-b78e28a296e6 req-c8a0373e-5f02-40fd-9d10-dc79685f275f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82", "name": "network-vif-deleted", "tag": "7d4a4424-af7b-47c8-93f8-df147eb9efd5"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:28.157456 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:28.162411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:28.167729 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9f346b79-5b47-4bfd-ba5b-7aa1eb80635f tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1218 microversion: 2.1 time: 0.155475 Sep 02 21:34:28.168045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e265fd69-2708-4e8f-ab0f-b78e28a296e6 req-c8a0373e-5f02-40fd-9d10-dc79685f275f service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:28.168778 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e265fd69-2708-4e8f-ab0f-b78e28a296e6 req-c8a0373e-5f02-40fd-9d10-dc79685f275f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:28.169238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-e265fd69-2708-4e8f-ab0f-b78e28a296e6 req-c8a0373e-5f02-40fd-9d10-dc79685f275f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:28.182367 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 646/1248] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:28 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:28.183625 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-e265fd69-2708-4e8f-ab0f-b78e28a296e6 req-c8a0373e-5f02-40fd-9d10-dc79685f275f service nova] Creating event network-vif-deleted:7d4a4424-af7b-47c8-93f8-df147eb9efd5 for instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 on hv-cinder-85220 Sep 02 21:34:28.190468 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-e265fd69-2708-4e8f-ab0f-b78e28a296e6 req-c8a0373e-5f02-40fd-9d10-dc79685f275f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330552 Sep 02 21:34:28.191007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 603/1249] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:28.205466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:28.205466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:28.205466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:28.205466 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:28.205932 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:28.206529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:28.206985 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:28.207412 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:28.283670 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:28.293231 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-a88ef15b-3aa3-431a-8723-d653dfe29f6f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1326 microversion: 2.1 time: 0.100478 Sep 02 21:34:28.293847 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 647/1250] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:28 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1326 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:29.198314 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:29.199018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:29.206467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:29.206959 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:29.207392 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:29.208099 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:29.208552 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:29.208975 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:29.245163 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:29.245572 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:29.246035 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:29.246496 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lazy-loading 'fault' on Instance uuid bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:34:29.292945 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1083cf32e76243ce9a88100374812ab7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '184566a121dd41218042897eeff2b216', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:29.301007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7bf80278-eb27-4551-8557-e6169ebd9225 tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 200 len: 1223 microversion: 2.1 time: 0.107440 Sep 02 21:34:29.301587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 604/1251] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:29 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:29.317645 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:29.318293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:29.328459 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:29.329036 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:29.329833 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:29.330568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:29.331030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:29.331614 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:29.369697 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:29.370224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:29.370657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:29.371110 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lazy-loading 'fault' on Instance uuid 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:34:29.420571 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:29.432247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-72482558-824b-4d9c-be0f-1dd8fef7e5c5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 200 len: 1331 microversion: 2.1 time: 0.118053 Sep 02 21:34:29.436072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 648/1252] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:29 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:30.324992 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:30.326187 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] [instance: bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:30.332887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:30.333389 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:30.333851 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:30.334573 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:30.335045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:30.335466 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:30.350821 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] HTTP exception thrown: Instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 could not be found. Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Request method failure captured: Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 HTTP/1.1 Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnWUn6VppWJZCOKHBMnebeeuX1iR5nutvlNXiMdgpegkEUPRkhjsWmrd9HBZo0yI1ftyv3RuTSLkaghaJCFU6g-BtksjeA_8y03_Y3YaxOJFHQUIwqIGhz2JzdRoFsfAZWE1MHKSEadhTQdWofY3B2XPWnmGxFS5F6l7_BNzFbWE4H8 Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: 184566a121dd41218042897eeff2b216 Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-TestShelveInstance-233582900 Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:34:30.352550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/184566a121dd41218042897eeff2b216"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_184566a121dd41218042897eeff2b216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/184566a121dd41218042897eeff2b216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/184566a121dd41218042897eeff2b216"}]}] Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-TestShelveInstance-233582900 Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: 184566a121dd41218042897eeff2b216 Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-TestShelveInstance-233582900 Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-TestShelveInstance-233582900-project Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: 1083cf32e76243ce9a88100374812ab7 Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-TestShelveInstance-233582900-project Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 could not be found. Sep 02 21:34:30.354409 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9'} Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 could not be found. Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:34:30.355848 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 could not be found. Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 could not be found. Sep 02 21:34:30.357526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.359397 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Returning 404 to user: Instance bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:34:30.359397 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e7c27d86-9402-4396-9a21-82b299dec88e tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9" status: 404 len: 111 microversion: 2.1 time: 0.033001 Sep 02 21:34:30.359397 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 605/1253] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:30 2022] GET /compute/v2.1/servers/bcf29bf9-5f79-4b0b-aa93-e8e1ecaedfb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:34:30.458762 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:30.459350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:30.468633 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:30.469052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:30.469486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:30.470222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:30.470680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:30.471096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:30.486302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 HTTP/1.1 Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:34:30.488022 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:34:30.490467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82'} Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:34:30.491741 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:34:30.493455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:34:30.495720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:34:30.495720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9e51ccbc-bb50-44ee-9fd9-3dc7d54f8d28 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 404 len: 111 microversion: 2.1 time: 0.034987 Sep 02 21:34:30.495720 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 649/1254] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:30 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 21:34:30.516289 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-aeb3296e-7cae-4c83-b783-e9c4993d6cc7 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '.version_select at 0x7fb00ccabdc0>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:30.616518 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-aeb3296e-7cae-4c83-b783-e9c4993d6cc7 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308951372" status: 202 len: 0 microversion: 2.1 time: 0.120011 Sep 02 21:34:30.620601 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 606/1255] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Sep 2 21:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1308951372 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:34:30.627305 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3418112a-05e0-4ec4-bff6-78e258eb8e0c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] Calling method '.version_select at 0x7fb00cfd39d0>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:30.730885 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3418112a-05e0-4ec4-bff6-78e258eb8e0c tempest-TestShelveInstance-233582900 tempest-TestShelveInstance-233582900-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-267356359" status: 202 len: 0 microversion: 2.1 time: 0.108746 Sep 02 21:34:30.735020 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 650/1256] 10.222.0.79 () {58 vars in 1251 bytes} [Fri Sep 2 21:34:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-267356359 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:34:31.896531 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-f2974f2b-74fc-4414-a4a9-41a179fd12d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: .version_select at 0x7fb00cb18160>, body: {"keypair": {"name": "tempest-keypair-1274680824", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJOqUSbWerjQhHswIoN6rxRRDcXCmeCMjdfLVsI2zMtIngAzyjxO5j2RMB7pWOJ8E4FGN0fOLNxd68CXA1wRKJWT2Ep+xqTymgfJB+WHB7zVthLklO7Es/td/nGUvxR8w=="}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:31.914012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-f2974f2b-74fc-4414-a4a9-41a179fd12d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:34:31.919821 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-f2974f2b-74fc-4414-a4a9-41a179fd12d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for user e343f998e5e34447bd2b5f0a2627bbdf and project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'key_pairs'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:34:32.017505 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-f2974f2b-74fc-4414-a4a9-41a179fd12d9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124990 Sep 02 21:34:32.018675 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 607/1257] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:34:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:35.204274 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-226942831", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ea88b9b-407d-410e-a71a-923bd00def20"}], "security_groups": [{"name": "tempest-securitygroup--1563930282"}], "key_name": "tempest-keypair-1274680824", "user_data": "}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:35.345244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.network.neutron [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] validate_networks() for [('4ea88b9b-407d-410e-a71a-923bd00def20', None, None, None, None, None)] {{(pid=121512) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:34:36.019224 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Flavor limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:34:36.019653 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Image limits 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:34:36.020125 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Flavor pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:34:36.020560 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Image pref 0:0:0 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:34:36.020966 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.virt.hardware [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:34:36.031247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:36.031739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:36.032172 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:36.032909 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:36.033343 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:36.033758 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:36.052507 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:34:36.057323 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for user e343f998e5e34447bd2b5f0a2627bbdf and project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'instances', 'ram', 'cores'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:34:36.069405 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Going to run 1 instances... {{(pid=121512) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:34:36.071887 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:34:36.257757 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-69170ba1-0d05-4691-8fdd-79bd4ea9ede9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.060162 Sep 02 21:34:36.259263 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 651/1258] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:34:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:34:36.272433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-5f11c031-5289-409d-9402-a9ae24bfb38f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:36.272998 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-5f11c031-5289-409d-9402-a9ae24bfb38f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:36.356082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-5f11c031-5289-409d-9402-a9ae24bfb38f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:36.363953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-5f11c031-5289-409d-9402-a9ae24bfb38f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1241 microversion: 2.1 time: 0.095282 Sep 02 21:34:36.364658 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 608/1259] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:36 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:37.390439 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:37.390439 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:37.396937 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:37.397451 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:37.397954 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:37.398640 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:37.399176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:37.400138 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:37.481005 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:37.490106 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e64e3d1a-63ca-4b0b-a108-09b14396f76b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1245 microversion: 2.1 time: 0.106706 Sep 02 21:34:37.490678 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 652/1260] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:37 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1245 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:38.515186 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:38.516128 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:38.523043 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:38.524045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:38.524679 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:38.525420 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:38.525958 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:38.526329 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:38.531467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:38.610070 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:38.616878 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8ed69ac4-2619-4e39-adcf-1e7bd06c0047 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1293 microversion: 2.1 time: 0.106609 Sep 02 21:34:38.617718 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 609/1261] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:38 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:39.645568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:39.646705 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:39.657162 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:39.659007 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:39.659690 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:39.660437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:39.661199 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:39.662026 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:39.739011 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:39.747201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f286edf6-bb59-415f-b86f-7bed6456b435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1299 microversion: 2.1 time: 0.107332 Sep 02 21:34:39.748014 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 653/1262] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:39 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:40.771958 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:40.772733 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:40.776201 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:40.783803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:40.784388 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:40.785101 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:40.786085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:40.786619 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:40.787110 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:41.020686 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:41.034275 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ecc0d465-69f3-48db-bdeb-776c44a4bcce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1367 microversion: 2.1 time: 0.266418 Sep 02 21:34:41.035488 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 610/1263] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:40 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:41.548547 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-58e0d98b-b4aa-406c-9ac7-4adc08d5408f req-c351c4c8-379d-47a5-9dfd-a746f49f0df9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32fb4544-d799-4ef2-b744-c4ce88356b0b", "tag": "fdb569d5-d150-4285-9d17-5fdfd342a232"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:41.554541 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:41.561029 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-58e0d98b-b4aa-406c-9ac7-4adc08d5408f req-c351c4c8-379d-47a5-9dfd-a746f49f0df9 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:41.565639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-58e0d98b-b4aa-406c-9ac7-4adc08d5408f req-c351c4c8-379d-47a5-9dfd-a746f49f0df9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:41.565639 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-58e0d98b-b4aa-406c-9ac7-4adc08d5408f req-c351c4c8-379d-47a5-9dfd-a746f49f0df9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:41.578318 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-58e0d98b-b4aa-406c-9ac7-4adc08d5408f req-c351c4c8-379d-47a5-9dfd-a746f49f0df9 service nova] Creating event network-changed:fdb569d5-d150-4285-9d17-5fdfd342a232 for instance 32fb4544-d799-4ef2-b744-c4ce88356b0b on hv-cinder-85220 Sep 02 21:34:41.583703 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-58e0d98b-b4aa-406c-9ac7-4adc08d5408f req-c351c4c8-379d-47a5-9dfd-a746f49f0df9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039814 Sep 02 21:34:41.585146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 654/1264] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:42.061343 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:42.062047 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:42.071982 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:42.075717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:42.075717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:42.075717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:42.075717 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:42.076504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:42.318505 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:42.326603 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7d52e520-38cd-49e6-ab3a-22da50ecc389 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1367 microversion: 2.1 time: 0.271416 Sep 02 21:34:42.327405 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 611/1265] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:42 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:43.349650 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:43.350414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:43.358408 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:43.358905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:43.359347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:43.360057 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:43.360508 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:43.360935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:43.502213 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:43.510472 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-aff6a7b6-1716-4215-bb9e-b63ec181a7eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1367 microversion: 2.1 time: 0.165397 Sep 02 21:34:43.511054 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 655/1266] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:43 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:34:44.535273 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:44.535999 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:44.543149 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:44.543562 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:44.544021 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:44.544719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:44.545169 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:44.545588 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:44.678247 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:44.686436 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ef245802-d0e9-48e0-a473-669411b6d3f0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1367 microversion: 2.1 time: 0.155053 Sep 02 21:34:44.687138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 612/1267] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:44 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:45.711543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:45.712292 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:45.719457 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:45.719936 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:45.720409 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:45.721190 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:45.721565 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:45.722023 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:45.867987 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:45.877709 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-de8b079e-2a5e-47f1-9322-de49e4090ca3 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1367 microversion: 2.1 time: 0.170568 Sep 02 21:34:45.878755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 656/1268] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:45 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:46.296734 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-b081776a-ed7a-4fab-9bad-ddc074b83d07 req-31a848de-beb4-4771-a642-f88eaea6721d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32fb4544-d799-4ef2-b744-c4ce88356b0b", "name": "network-vif-plugged", "status": "completed", "tag": "fdb569d5-d150-4285-9d17-5fdfd342a232"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:46.306321 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b081776a-ed7a-4fab-9bad-ddc074b83d07 req-31a848de-beb4-4771-a642-f88eaea6721d service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:46.306792 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b081776a-ed7a-4fab-9bad-ddc074b83d07 req-31a848de-beb4-4771-a642-f88eaea6721d service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:46.307244 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-b081776a-ed7a-4fab-9bad-ddc074b83d07 req-31a848de-beb4-4771-a642-f88eaea6721d service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:46.319480 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-b081776a-ed7a-4fab-9bad-ddc074b83d07 req-31a848de-beb4-4771-a642-f88eaea6721d service nova] Creating event network-vif-plugged:fdb569d5-d150-4285-9d17-5fdfd342a232 for instance 32fb4544-d799-4ef2-b744-c4ce88356b0b on hv-cinder-85220 Sep 02 21:34:46.324346 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-b081776a-ed7a-4fab-9bad-ddc074b83d07 req-31a848de-beb4-4771-a642-f88eaea6721d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222955 Sep 02 21:34:46.325858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 613/1269] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:46.903460 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:46.904101 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:46.906147 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=2 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:46.907239 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=6 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:46.912211 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:46.912696 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:46.913130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:46.913855 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:46.914310 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:46.914723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:47.055390 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:47.064055 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ab5f44d0-79e4-4fde-affa-c8a241d16b33 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1367 microversion: 2.1 time: 0.165180 Sep 02 21:34:47.067828 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 657/1270] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:46 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:48.084926 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:34:48.089587 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:48.091087 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:48.097670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:48.100014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:48.100014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:48.100014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:48.100014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:48.100422 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:48.240478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:48.248714 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-e4558404-5880-4a6e-9f9c-fb8040acd85f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1367 microversion: 2.1 time: 0.164731 Sep 02 21:34:48.249299 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 614/1271] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:48 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:34:49.271804 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:49.272422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:49.280094 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:49.280583 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:49.281023 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:49.281739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:49.282227 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:49.282658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:49.423955 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:34:49.431933 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e4f1422d-809f-4c59-b13d-2c4c04ea93b8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1558 microversion: 2.1 time: 0.164099 Sep 02 21:34:49.436925 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 658/1272] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:34:49 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:34:49.455495 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:34:49.456213 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:34:49.463078 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:49.463569 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:49.464006 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:49.464720 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:49.465181 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:49.465608 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:49.549157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-1ccaa548-c523-4d82-9141-cc9793e57469 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097825 Sep 02 21:34:49.549831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 615/1273] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Sep 2 21:34:49 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:34:50.631755 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-fa65de07-c613-49ee-a913-ef86e9c396b8 req-86e721de-a5d8-4b0d-9954-d8db7a0fd04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32fb4544-d799-4ef2-b744-c4ce88356b0b", "tag": "fdb569d5-d150-4285-9d17-5fdfd342a232"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:34:50.642373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-fa65de07-c613-49ee-a913-ef86e9c396b8 req-86e721de-a5d8-4b0d-9954-d8db7a0fd04b service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:34:50.642854 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-fa65de07-c613-49ee-a913-ef86e9c396b8 req-86e721de-a5d8-4b0d-9954-d8db7a0fd04b service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:34:50.643287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-fa65de07-c613-49ee-a913-ef86e9c396b8 req-86e721de-a5d8-4b0d-9954-d8db7a0fd04b service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:34:50.655414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-fa65de07-c613-49ee-a913-ef86e9c396b8 req-86e721de-a5d8-4b0d-9954-d8db7a0fd04b service nova] Creating event network-changed:fdb569d5-d150-4285-9d17-5fdfd342a232 for instance 32fb4544-d799-4ef2-b744-c4ce88356b0b on hv-cinder-85220 Sep 02 21:34:50.660692 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-fa65de07-c613-49ee-a913-ef86e9c396b8 req-86e721de-a5d8-4b0d-9954-d8db7a0fd04b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032856 Sep 02 21:34:50.661507 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 659/1274] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:09.088945 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=11 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:09.090134 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=34 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:09.094905 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:09.095429 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-2d8c07f2-c817-4eda-927f-f3442e1146ae req-7637229c-d8bf-4bab-be7d-184ddf02e49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12699de1-4608-4c0a-a0cc-a0a03ff20558", "tag": "8906f02a-945e-410d-bee4-826c1bd21af4"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:09.096109 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:09.102588 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:09.103376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:09.104033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:09.104770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:09.105231 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:09.105655 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:09.110990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=11 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:09.113203 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=58 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:09.114685 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-2d8c07f2-c817-4eda-927f-f3442e1146ae req-7637229c-d8bf-4bab-be7d-184ddf02e49a service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:09.115244 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-2d8c07f2-c817-4eda-927f-f3442e1146ae req-7637229c-d8bf-4bab-be7d-184ddf02e49a service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:09.116049 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-2d8c07f2-c817-4eda-927f-f3442e1146ae req-7637229c-d8bf-4bab-be7d-184ddf02e49a service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:09.129197 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-2d8c07f2-c817-4eda-927f-f3442e1146ae req-7637229c-d8bf-4bab-be7d-184ddf02e49a service nova] Creating event network-changed:8906f02a-945e-410d-bee4-826c1bd21af4 for instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 on hv-cinder-85220 Sep 02 21:35:09.135200 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-2d8c07f2-c817-4eda-927f-f3442e1146ae req-7637229c-d8bf-4bab-be7d-184ddf02e49a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045572 Sep 02 21:35:09.142117 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 660/1275] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:09.143015 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Going to try to terminate instance {{(pid=121513) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:35:09.574138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4c9eff13-c5bb-40c1-8f1b-e1465fb16a0f tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "DELETE /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 204 len: 0 microversion: 2.1 time: 0.485879 Sep 02 21:35:09.586969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 616/1276] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:35:09 2022] DELETE /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:35:09.587178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:09.587178 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:09.593251 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:09.594746 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:09.595396 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:09.596145 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:09.596941 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:09.597420 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:09.793332 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:09.803097 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-c0e8f6e2-20f1-48ae-aa74-3cde66c42e06 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1577 microversion: 2.1 time: 0.222690 Sep 02 21:35:09.807287 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 661/1277] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:09 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:10.830643 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:10.831347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:10.838072 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:10.838555 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:10.839094 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:10.839716 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:10.840175 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:10.840785 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:11.068361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:11.077707 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a0999055-a4eb-4089-9aa7-ab3cd6312987 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1577 microversion: 2.1 time: 0.251690 Sep 02 21:35:11.079195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 617/1278] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:10 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:12.104510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:12.105222 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:12.112747 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.113247 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.113691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.114433 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.114895 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.115326 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.229042 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:12.239580 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-eee94720-07d2-49d0-94dd-64c5d61b88ba tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1392 microversion: 2.1 time: 0.139116 Sep 02 21:35:12.240252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 662/1279] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:12 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1392 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:12.270352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-44fe8ffc-5802-4ee2-b65b-0f190d5354fb req-4d902fa6-216b-4059-ba42-f3030e8bb3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12699de1-4608-4c0a-a0cc-a0a03ff20558", "name": "network-vif-deleted", "tag": "8906f02a-945e-410d-bee4-826c1bd21af4"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:12.280479 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-44fe8ffc-5802-4ee2-b65b-0f190d5354fb req-4d902fa6-216b-4059-ba42-f3030e8bb3c4 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:12.281879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-44fe8ffc-5802-4ee2-b65b-0f190d5354fb req-4d902fa6-216b-4059-ba42-f3030e8bb3c4 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:12.282194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-44fe8ffc-5802-4ee2-b65b-0f190d5354fb req-4d902fa6-216b-4059-ba42-f3030e8bb3c4 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:12.296182 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-44fe8ffc-5802-4ee2-b65b-0f190d5354fb req-4d902fa6-216b-4059-ba42-f3030e8bb3c4 service nova] Creating event network-vif-deleted:8906f02a-945e-410d-bee4-826c1bd21af4 for instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 on hv-cinder-85220 Sep 02 21:35:12.302841 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-44fe8ffc-5802-4ee2-b65b-0f190d5354fb req-4d902fa6-216b-4059-ba42-f3030e8bb3c4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037360 Sep 02 21:35:12.303640 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 618/1280] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:13.272281 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:13.273045 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:13.280543 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:13.280942 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:13.281549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:13.282430 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:13.282939 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:13.283407 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:13.318461 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:13.319691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:13.319691 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:13.320185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lazy-loading 'fault' on Instance uuid 12699de1-4608-4c0a-a0cc-a0a03ff20558 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:13.364608 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:13.373079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-93dea979-7881-454a-9561-9aaeb1732040 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 200 len: 1230 microversion: 2.1 time: 0.104539 Sep 02 21:35:13.373791 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 663/1281] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:13 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:14.404067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:14.404679 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 12699de1-4608-4c0a-a0cc-a0a03ff20558] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:14.411646 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:14.412124 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:14.416463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:14.416463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:14.416463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:14.416463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:14.431478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] HTTP exception thrown: Instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 could not be found. Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Request method failure captured: Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 HTTP/1.1 Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnSea43Qxa8TH4GEWgsT96CNditwYodKMydT-Ma_7airb3DJK3KavKHm15z2YaHMLApwAzrOvQxttuASxbCTP8mYQM_9VAvUtlpbxvXeFdCwQH7TUMKmycN0yNz3ILt20BEy8Gb__hpDmmf1tk_Iqw2nB3cOSd2U_csP22vjRD27Rjg Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:35:14.433210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}] Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e2940758d8424054bf3a68a42b79bb81 Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 could not be found. Sep 02 21:35:14.435123 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '12699de1-4608-4c0a-a0cc-a0a03ff20558'} Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 could not be found. Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:14.436361 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 could not be found. Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 could not be found. Sep 02 21:35:14.438172 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:14.439819 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Returning 404 to user: Instance 12699de1-4608-4c0a-a0cc-a0a03ff20558 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:14.439819 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-05065964-ee2f-4938-a223-50ce866bc5b5 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558" status: 404 len: 111 microversion: 2.1 time: 0.035525 Sep 02 21:35:14.439819 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 619/1282] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:14 2022] GET /compute/v2.1/servers/12699de1-4608-4c0a-a0cc-a0a03ff20558 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:18.135188 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-1d9d75aa-2b2b-4b36-ad0c-9525a989d905 req-dd7c7022-c241-4c93-8f11-50876bf7d66e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86f6c53-b430-449d-9788-8b80d3c3b540", "tag": "14b2721f-8d73-4e00-955d-00d02b29a184"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:18.138130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:18.139322 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:18.148227 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1d9d75aa-2b2b-4b36-ad0c-9525a989d905 req-dd7c7022-c241-4c93-8f11-50876bf7d66e service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:18.148725 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1d9d75aa-2b2b-4b36-ad0c-9525a989d905 req-dd7c7022-c241-4c93-8f11-50876bf7d66e service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:18.149152 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-1d9d75aa-2b2b-4b36-ad0c-9525a989d905 req-dd7c7022-c241-4c93-8f11-50876bf7d66e service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:18.151434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:18.152268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:18.153183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:18.155035 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:18.156252 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:18.157130 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:18.165290 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-1d9d75aa-2b2b-4b36-ad0c-9525a989d905 req-dd7c7022-c241-4c93-8f11-50876bf7d66e service nova] Creating event network-changed:14b2721f-8d73-4e00-955d-00d02b29a184 for instance c86f6c53-b430-449d-9788-8b80d3c3b540 on hv-cinder-85220 Sep 02 21:35:18.168904 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-1d9d75aa-2b2b-4b36-ad0c-9525a989d905 req-dd7c7022-c241-4c93-8f11-50876bf7d66e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038582 Sep 02 21:35:18.169526 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 620/1283] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:18.196568 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:35:19.053677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0d9a1f4a-dbec-4950-811e-c331219119c7 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 204 len: 0 microversion: 2.1 time: 0.923697 Sep 02 21:35:19.054862 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 664/1284] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:35:18 2022] DELETE /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 0 bytes in 927 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:35:19.067930 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:19.068966 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:19.083421 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:19.084082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:19.084670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:19.085629 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:19.086386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:19.086821 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:19.328723 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:19.337792 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-833ec69d-1dba-493f-b364-76cb0373d9f6 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1576 microversion: 2.1 time: 0.275959 Sep 02 21:35:19.338591 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 621/1285] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:19 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1576 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:20.366176 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:20.366896 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:20.374772 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:20.375511 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:20.375956 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:20.376689 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:20.377146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:20.377576 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:20.545880 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:20.555028 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-3b654933-e269-43e4-a989-7d7c6909cc08 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1576 microversion: 2.1 time: 0.193141 Sep 02 21:35:20.555609 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 665/1286] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:20 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1576 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:35:21.582563 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:21.583550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:21.597955 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:21.598613 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:21.599154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:21.600155 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:21.600618 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:21.601044 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:21.658067 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-736c0a36-06dc-4ddf-bb0c-7c496916d2b0 req-d2ec390b-3a4e-4388-86fd-2f50e755bd9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86f6c53-b430-449d-9788-8b80d3c3b540", "name": "network-vif-deleted", "tag": "14b2721f-8d73-4e00-955d-00d02b29a184"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:21.670347 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-736c0a36-06dc-4ddf-bb0c-7c496916d2b0 req-d2ec390b-3a4e-4388-86fd-2f50e755bd9b service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:21.671446 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-736c0a36-06dc-4ddf-bb0c-7c496916d2b0 req-d2ec390b-3a4e-4388-86fd-2f50e755bd9b service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:21.671894 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-736c0a36-06dc-4ddf-bb0c-7c496916d2b0 req-d2ec390b-3a4e-4388-86fd-2f50e755bd9b service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:21.692820 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-736c0a36-06dc-4ddf-bb0c-7c496916d2b0 req-d2ec390b-3a4e-4388-86fd-2f50e755bd9b service nova] Creating event network-vif-deleted:14b2721f-8d73-4e00-955d-00d02b29a184 for instance c86f6c53-b430-449d-9788-8b80d3c3b540 on hv-cinder-85220 Sep 02 21:35:21.694240 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:21.699349 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-736c0a36-06dc-4ddf-bb0c-7c496916d2b0 req-d2ec390b-3a4e-4388-86fd-2f50e755bd9b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046365 Sep 02 21:35:21.700235 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 666/1287] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:35:21.710487 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-031d5dab-c574-45f8-95f9-83b5f2de20dc tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1390 microversion: 2.1 time: 0.134373 Sep 02 21:35:21.711164 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 622/1288] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:21 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1390 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:22.750549 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:22.751342 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:22.759502 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:22.759996 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:22.760441 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:22.761193 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:22.761712 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:22.762218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:22.800812 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:22.801392 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:22.801930 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:22.802442 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lazy-loading 'fault' on Instance uuid c86f6c53-b430-449d-9788-8b80d3c3b540 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:22.847307 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2940758d8424054bf3a68a42b79bb81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0d9b4769b124ec69714a30d02bb8557', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:22.856655 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7869547c-7447-4a36-9c83-caa97118db9c tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 200 len: 1229 microversion: 2.1 time: 0.112438 Sep 02 21:35:22.857261 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 667/1289] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:22 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 1229 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:23.882411 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:23.883014 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: c86f6c53-b430-449d-9788-8b80d3c3b540] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:23.889951 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:23.892198 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:23.893173 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:23.893954 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:23.894432 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:23.895045 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:23.918433 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] HTTP exception thrown: Instance c86f6c53-b430-449d-9788-8b80d3c3b540 could not be found. Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Request method failure captured: Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 HTTP/1.1 Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnSea43Qxa8TH4GEWgsT96CNditwYodKMydT-Ma_7airb3DJK3KavKHm15z2YaHMLApwAzrOvQxttuASxbCTP8mYQM_9VAvUtlpbxvXeFdCwQH7TUMKmycN0yNz3ILt20BEy8Gb__hpDmmf1tk_Iqw2nB3cOSd2U_csP22vjRD27Rjg Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:35:23.920158 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}] Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e2940758d8424054bf3a68a42b79bb81 Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance c86f6c53-b430-449d-9788-8b80d3c3b540 could not be found. Sep 02 21:35:23.924893 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': 'c86f6c53-b430-449d-9788-8b80d3c3b540'} Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86f6c53-b430-449d-9788-8b80d3c3b540 could not be found. Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:23.926456 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86f6c53-b430-449d-9788-8b80d3c3b540 could not be found. Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86f6c53-b430-449d-9788-8b80d3c3b540 could not be found. Sep 02 21:35:23.929283 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:23.932269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Returning 404 to user: Instance c86f6c53-b430-449d-9788-8b80d3c3b540 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:23.932269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ac0f1a40-29ad-4627-84fe-04918381b0db tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540" status: 404 len: 111 microversion: 2.1 time: 0.043887 Sep 02 21:35:23.932269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 623/1290] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:23 2022] GET /compute/v2.1/servers/c86f6c53-b430-449d-9788-8b80d3c3b540 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:24.608987 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:24.609588 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:24.616396 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:24.616888 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:24.617330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:24.618072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:24.618529 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:24.619072 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:24.639421 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] HTTP exception thrown: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Request method failure captured: Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 HTTP/1.1 Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnSea43Qxa8TH4GEWgsT96CNditwYodKMydT-Ma_7airb3DJK3KavKHm15z2YaHMLApwAzrOvQxttuASxbCTP8mYQM_9VAvUtlpbxvXeFdCwQH7TUMKmycN0yNz3ILt20BEy8Gb__hpDmmf1tk_Iqw2nB3cOSd2U_csP22vjRD27Rjg Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:35:24.641228 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}] Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e2940758d8424054bf3a68a42b79bb81 Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.644498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '388a2bcc-b930-4062-9ab7-e611f34dc102'} Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:24.645680 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.647333 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.648935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Returning 404 to user: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:24.648935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-0407a26d-bbd9-4f7d-8677-cb74550f8743 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "DELETE /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 404 len: 111 microversion: 2.1 time: 0.037784 Sep 02 21:35:24.648935 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 668/1291] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:35:24 2022] DELETE /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:24.656967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:24.658067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] [instance: 388a2bcc-b930-4062-9ab7-e611f34dc102] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:24.669792 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:24.670706 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:24.671940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:24.673240 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:24.674143 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:24.674942 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:24.703981 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] HTTP exception thrown: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Request method failure captured: Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 HTTP/1.1 Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnSea43Qxa8TH4GEWgsT96CNditwYodKMydT-Ma_7airb3DJK3KavKHm15z2YaHMLApwAzrOvQxttuASxbCTP8mYQM_9VAvUtlpbxvXeFdCwQH7TUMKmycN0yNz3ILt20BEy8Gb__hpDmmf1tk_Iqw2nB3cOSd2U_csP22vjRD27Rjg Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:35:24.707007 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0d9b4769b124ec69714a30d02bb8557"}]}] Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0d9b4769b124ec69714a30d02bb8557 Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-TestVolumeBootPattern-133567657 Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e2940758d8424054bf3a68a42b79bb81 Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-TestVolumeBootPattern-133567657-project Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.710023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '388a2bcc-b930-4062-9ab7-e611f34dc102'} Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:24.712764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. Sep 02 21:35:24.715657 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:24.718286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Returning 404 to user: Instance 388a2bcc-b930-4062-9ab7-e611f34dc102 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:24.718286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ba7423f2-c3c0-41c2-bd46-6f3c801417f8 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102" status: 404 len: 111 microversion: 2.1 time: 0.060094 Sep 02 21:35:24.718286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 624/1292] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:24 2022] GET /compute/v2.1/servers/388a2bcc-b930-4062-9ab7-e611f34dc102 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:26.399676 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-338ffefd-12eb-4007-b30a-aae82b650452 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] Calling method '.version_select at 0x7fb00c96d8b0>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:26.526362 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-338ffefd-12eb-4007-b30a-aae82b650452 tempest-TestVolumeBootPattern-133567657 tempest-TestVolumeBootPattern-133567657-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-261479926" status: 202 len: 0 microversion: 2.1 time: 0.130513 Sep 02 21:35:26.526950 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 669/1293] 10.222.0.79 () {58 vars in 1260 bytes} [Fri Sep 2 21:35:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-261479926 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:35:26.687600 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:26.689067 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:26.696348 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:26.696850 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:26.697305 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:26.698194 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:26.698655 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:26.699077 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:26.730563 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a96dd9b3-903f-45be-a8d2-6c3893bd1414 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/ips" status: 200 len: 150 microversion: 2.1 time: 0.047759 Sep 02 21:35:26.731141 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 625/1294] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:35:26 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:28.474068 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fcf3d08-7051-4337-9e45-b61599473b97"}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:28.476801 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:28.484020 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:28.484510 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:28.484943 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:28.485658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:28.486491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:28.486629 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:29.398582 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-04a7c1e1-86e4-4e32-b6f4-bb4c827c9705 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.928877 Sep 02 21:35:29.399496 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 670/1295] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:35:28 2022] POST /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:38.116924 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fcf3d08-7051-4337-9e45-b61599473b97"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:38.119352 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:38.122023 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:38.122693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:38.127757 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:38.128238 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:38.128675 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.129384 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:38.129857 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:38.130286 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.215770 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Invalid volume: volume 2fcf3d08-7051-4337-9e45-b61599473b97 is already attached to instances: 32fb4544-d799-4ef2-b744-c4ce88356b0b Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: POST /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments HTTP/1.1 Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 74 Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:35:38.218018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {"volumeAttachment": {"volumeId": "2fcf3d08-7051-4337-9e45-b61599473b97"}} Sep 02 21:35:38.219814 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Invalid volume: volume 2fcf3d08-7051-4337-9e45-b61599473b97 is already attached to instances: 32fb4544-d799-4ef2-b744-c4ce88356b0b Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'server_id': '32fb4544-d799-4ef2-b744-c4ce88356b0b', 'body': {'volumeAttachment': {'volumeId': '2fcf3d08-7051-4337-9e45-b61599473b97'}}} Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2fcf3d08-7051-4337-9e45-b61599473b97 is already attached to instances: 32fb4544-d799-4ef2-b744-c4ce88356b0b Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:38.220887 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2fcf3d08-7051-4337-9e45-b61599473b97 is already attached to instances: 32fb4544-d799-4ef2-b744-c4ce88356b0b Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:38.222406 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:38.223950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:38.223950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:38.223950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:38.223950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2fcf3d08-7051-4337-9e45-b61599473b97 is already attached to instances: 32fb4544-d799-4ef2-b744-c4ce88356b0b Sep 02 21:35:38.223950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:35:38.223950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 400 to user: Invalid volume: volume 2fcf3d08-7051-4337-9e45-b61599473b97 is already attached to instances: 32fb4544-d799-4ef2-b744-c4ce88356b0b {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:38.223950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-65d53418-731a-445f-9d44-c5935f27ca2a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107031 Sep 02 21:35:38.223950 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 626/1296] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:35:38 2022] POST /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 21:35:38.294900 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:38.295524 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:38.302589 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:38.304934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:38.304934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.304934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:38.304934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:38.305366 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.396218 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lazy-loading 'services' on Instance uuid 32fb4544-d799-4ef2-b744-c4ce88356b0b {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:38.758586 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4e109ed8-7319-4445-822b-919c38245c96 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments/2fcf3d08-7051-4337-9e45-b61599473b97" status: 202 len: 0 microversion: 2.1 time: 0.468434 Sep 02 21:35:38.759185 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 671/1297] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:35:38 2022] DELETE /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments/2fcf3d08-7051-4337-9e45-b61599473b97 => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:35:38.769414 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:38.771839 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:38.779127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:38.779622 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:38.780705 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.781431 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:38.781916 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:38.782344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:38.815028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4b8c6c03-4c67-4fbe-a1be-16d98ae917e2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050658 Sep 02 21:35:38.815585 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 627/1298] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:38 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:39.828937 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:39.831341 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:39.833399 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:39.838439 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:39.838929 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:39.839373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:39.840081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:39.840540 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:39.840965 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:39.844770 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:35:39.872690 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4139e22f-d726-4250-a441-79e7b6394fc4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048591 Sep 02 21:35:39.873264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 672/1299] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:39 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:40.886271 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:40.888538 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:40.896463 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:40.896943 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:40.897382 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:40.898127 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:40.898580 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:40.899009 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:40.929317 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-d6dc2a84-066c-4205-8291-86cd38072d83 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047143 Sep 02 21:35:40.929916 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 628/1300] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:35:40 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:35:40.996769 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:40.997330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:41.005950 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:41.006443 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:41.006934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:41.007619 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:41.008073 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:41.008498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:41.035652 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:35:41.507065 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-26dd5f71-e42a-49c6-b033-49e199bc37a8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 204 len: 0 microversion: 2.1 time: 0.514195 Sep 02 21:35:41.507694 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 673/1301] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:35:40 2022] DELETE /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:35:41.517135 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:41.528095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:41.528095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:41.528095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:41.528095 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:41.528543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:41.528543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:41.528543 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:41.664084 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:41.672036 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-60e3031f-cb3f-4c1b-9e70-41df43009fa5 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1682 microversion: 2.1 time: 0.159195 Sep 02 21:35:41.672596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 629/1302] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:41 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:42.697279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:42.698166 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:42.704701 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:42.705973 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:42.706595 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:42.707302 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:42.707754 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:42.708175 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:42.845096 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:42.855268 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-26a239d7-544b-4409-8888-b1be2cb39fb2 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1682 microversion: 2.1 time: 0.162327 Sep 02 21:35:42.855850 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 674/1303] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:42 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:43.879870 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:43.880494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:43.887301 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:43.887787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:43.888218 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:43.888935 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:43.889386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:43.889837 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:44.034335 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:44.044086 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-0b4f6658-993e-40c0-921e-470635bcc408 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1682 microversion: 2.1 time: 0.168601 Sep 02 21:35:44.057957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 630/1304] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:43 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:44.364544 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-331be645-ef3e-4f20-9b46-bf1753992d98 req-8ef95455-e099-4fa6-bdd0-afed1f65150f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32fb4544-d799-4ef2-b744-c4ce88356b0b", "name": "network-vif-deleted", "tag": "fdb569d5-d150-4285-9d17-5fdfd342a232"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:44.377747 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-331be645-ef3e-4f20-9b46-bf1753992d98 req-8ef95455-e099-4fa6-bdd0-afed1f65150f service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:44.380076 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-331be645-ef3e-4f20-9b46-bf1753992d98 req-8ef95455-e099-4fa6-bdd0-afed1f65150f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:44.380528 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-331be645-ef3e-4f20-9b46-bf1753992d98 req-8ef95455-e099-4fa6-bdd0-afed1f65150f service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:44.393146 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-331be645-ef3e-4f20-9b46-bf1753992d98 req-8ef95455-e099-4fa6-bdd0-afed1f65150f service nova] Creating event network-vif-deleted:fdb569d5-d150-4285-9d17-5fdfd342a232 for instance 32fb4544-d799-4ef2-b744-c4ce88356b0b on hv-cinder-85220 Sep 02 21:35:44.398821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-331be645-ef3e-4f20-9b46-bf1753992d98 req-8ef95455-e099-4fa6-bdd0-afed1f65150f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039477 Sep 02 21:35:44.399916 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 675/1305] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:45.068685 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:45.069311 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:45.075934 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:45.076425 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:45.076874 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:45.077586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:45.078069 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:45.078502 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:45.111645 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:45.112230 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:45.112752 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:45.113195 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lazy-loading 'fault' on Instance uuid 32fb4544-d799-4ef2-b744-c4ce88356b0b {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:35:45.159533 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:45.172318 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-7a1bee87-9f35-45f9-8e42-168657972e37 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 200 len: 1331 microversion: 2.1 time: 0.108201 Sep 02 21:35:45.173037 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 631/1306] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:45 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:46.197107 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:46.197818 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:46.204003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.204525 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.205534 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.206436 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:46.206890 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:46.207312 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:46.221437 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b HTTP/1.1 Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:35:46.223122 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:35:46.225250 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '32fb4544-d799-4ef2-b744-c4ce88356b0b'} Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:35:46.226134 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:35:46.227475 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:35:46.228711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:35:46.228711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-355b3a2c-6bd3-43a7-9367-ec52776c1969 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 404 len: 111 microversion: 2.1 time: 0.032107 Sep 02 21:35:46.228711 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 676/1307] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:46 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:35:46.234066 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-ee99d662-fcb3-4fd0-ba6c-5534d05111eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '.version_select at 0x7fb00cbfeb80>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:46.324342 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-ee99d662-fcb3-4fd0-ba6c-5534d05111eb tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274680824" status: 202 len: 0 microversion: 2.1 time: 0.094112 Sep 02 21:35:46.324957 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 632/1308] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Sep 2 21:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1274680824 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:35:47.089009 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-ef3966f8-e98e-43fa-b99b-8205b477deba tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: .version_select at 0x7fb00c9d6f70>, body: {"keypair": {"name": "tempest-keypair-1538913154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNAfWjWOwRhldf4CdNN+EYE5bOM1mZfBfmLuZ5fjV3VqzDp4Jsecme1gDkgBhry1Ato7s+WaPj6I/4z204sTaKfyg8vCH6C7erfAp2/6k6xrI9V/YvZCHTCvurnniSm+A=="}} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:47.105663 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-ef3966f8-e98e-43fa-b99b-8205b477deba tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:35:47.109531 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.quota [None req-ef3966f8-e98e-43fa-b99b-8205b477deba tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for user e343f998e5e34447bd2b5f0a2627bbdf and project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'key_pairs'} {{(pid=121512) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:35:47.227627 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-ef3966f8-e98e-43fa-b99b-8205b477deba tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142447 Sep 02 21:35:47.228384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 677/1309] 10.222.0.79 () {60 vars in 1159 bytes} [Fri Sep 2 21:35:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:49.843602 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1746175784", "imageRef": "12b6b99e-fa62-4341-b982-efdb84323db9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ea88b9b-407d-410e-a71a-923bd00def20"}], "security_groups": [{"name": "tempest-securitygroup--248124753"}], "key_name": "tempest-keypair-1538913154", "user_data": "}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:49.955606 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.network.neutron [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] validate_networks() for [('4ea88b9b-407d-410e-a71a-923bd00def20', None, None, None, None, None)] {{(pid=121513) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 02 21:35:50.450736 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Flavor limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 21:35:50.451219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Image limits 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 21:35:50.451689 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Flavor pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 21:35:50.452097 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Image pref 0:0:0 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 21:35:50.452514 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.virt.hardware [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121513) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 21:35:50.461467 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:50.461981 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:50.462415 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:50.463159 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:50.463606 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:50.464027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:50.480856 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 02 21:35:50.484708 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.quota [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Getting quotas for user e343f998e5e34447bd2b5f0a2627bbdf and project d0e4c1f5dfdb49abb0ca5ca324976acb. Resources: {'instances', 'ram', 'cores'} {{(pid=121513) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 02 21:35:50.495894 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Going to run 1 instances... {{(pid=121513) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 02 21:35:50.498223 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='12b6b99e-fa62-4341-b982-efdb84323db9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121513) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 02 21:35:50.640249 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6ce37b35-36cb-48c9-9be0-c0b20b2796ee tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.804051 Sep 02 21:35:50.640879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 633/1310] 10.222.0.79 () {60 vars in 1147 bytes} [Fri Sep 2 21:35:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 21:35:50.652411 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4450d218-e6d5-430e-8b4a-31ade70c8f24 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:50.653208 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4450d218-e6d5-430e-8b4a-31ade70c8f24 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:50.716512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-4450d218-e6d5-430e-8b4a-31ade70c8f24 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:50.724739 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4450d218-e6d5-430e-8b4a-31ade70c8f24 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1242 microversion: 2.1 time: 0.076045 Sep 02 21:35:50.725323 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 678/1311] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:50 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:51.749465 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:51.750270 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:51.757177 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:51.757693 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:51.758169 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:51.758890 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:51.759443 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:51.759775 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:51.830928 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:51.838804 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-4f3aa39f-3dc3-4298-a6aa-71a5c235470b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1246 microversion: 2.1 time: 0.094021 Sep 02 21:35:51.839371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 634/1312] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:51 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:52.864772 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:52.865380 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:52.872500 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:52.873140 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:52.873468 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:52.874391 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:52.874897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:52.875320 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:52.952553 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:52.960961 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-216175a8-7db7-46d5-9cf7-b3295feb9841 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1294 microversion: 2.1 time: 0.102007 Sep 02 21:35:52.961536 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 679/1313] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:52 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1294 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:53.984969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:53.986347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:53.993109 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:53.993595 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:53.994061 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:53.996881 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:53.997347 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:53.997780 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:54.249764 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:54.259625 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-8c785b8f-b17c-4cb7-a025-90a7a0285974 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1367 microversion: 2.1 time: 0.278456 Sep 02 21:35:54.260217 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 635/1314] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:53 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1367 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:54.867384 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-d124706b-1433-45e3-b559-66be4d93720e req-0a3fd689-dc69-4f4d-b2c6-d19097233ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e124a5-544f-4269-a7a8-7092758233c2", "tag": "d4613165-5d26-42a0-8ce9-00b3cd463123"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:35:54.881499 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d124706b-1433-45e3-b559-66be4d93720e req-0a3fd689-dc69-4f4d-b2c6-d19097233ec9 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:54.884835 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d124706b-1433-45e3-b559-66be4d93720e req-0a3fd689-dc69-4f4d-b2c6-d19097233ec9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:54.884835 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-d124706b-1433-45e3-b559-66be4d93720e req-0a3fd689-dc69-4f4d-b2c6-d19097233ec9 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:54.894710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-d124706b-1433-45e3-b559-66be4d93720e req-0a3fd689-dc69-4f4d-b2c6-d19097233ec9 service nova] Creating event network-changed:d4613165-5d26-42a0-8ce9-00b3cd463123 for instance 75e124a5-544f-4269-a7a8-7092758233c2 on hv-cinder-85220 Sep 02 21:35:54.899923 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-d124706b-1433-45e3-b559-66be4d93720e req-0a3fd689-dc69-4f4d-b2c6-d19097233ec9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040339 Sep 02 21:35:54.900717 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 680/1315] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:35:55.285345 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:55.285989 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:55.292448 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:55.292941 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:55.293380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:55.294118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:55.294579 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:55.295010 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:55.504699 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:55.512967 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-403a1bf3-2987-4986-9aa1-6096916c5042 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1367 microversion: 2.1 time: 0.232018 Sep 02 21:35:55.513548 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 636/1316] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:55 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:56.536791 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:56.537491 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:56.543759 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:56.544243 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:56.544706 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:56.545399 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:56.545875 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:56.546301 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:56.688458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:56.688458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f67fb0b2-fb58-493d-822d-180ba7ff8043 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1367 microversion: 2.1 time: 0.155687 Sep 02 21:35:56.688458 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 681/1317] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:56 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:57.712380 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:57.713022 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:57.719550 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:57.720073 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:57.720504 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:57.721190 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:57.722397 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:57.722831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:57.882131 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:57.890262 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-783a5c7e-5da6-49fe-9ade-130f6562706c tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1367 microversion: 2.1 time: 0.181846 Sep 02 21:35:57.892766 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 637/1318] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:57 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:35:58.920422 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:35:58.921081 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:35:58.928319 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:58.928805 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:58.929884 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:58.930600 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:35:58.931052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:35:58.932119 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:35:59.085728 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:35:59.093657 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bd113814-80e3-4264-a7ba-2579e2fc7c97 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1367 microversion: 2.1 time: 0.177051 Sep 02 21:35:59.094264 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 682/1319] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:35:58 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:36:00.116667 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:00.117267 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:00.123840 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:00.124331 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:00.124772 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:00.126330 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:00.126330 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:00.126330 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:00.273373 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:36:00.281862 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-a90bc7ef-cbae-4d55-a399-df060de4f686 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1367 microversion: 2.1 time: 0.168975 Sep 02 21:36:00.282441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 638/1320] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:36:00 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:36:00.610541 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-23991d27-8015-4fd6-97f2-1c6bd494144a req-1aa7c096-9fcd-4204-a931-13bc4322cd21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e124a5-544f-4269-a7a8-7092758233c2", "name": "network-vif-plugged", "status": "completed", "tag": "d4613165-5d26-42a0-8ce9-00b3cd463123"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:36:00.625723 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-23991d27-8015-4fd6-97f2-1c6bd494144a req-1aa7c096-9fcd-4204-a931-13bc4322cd21 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:00.626156 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-23991d27-8015-4fd6-97f2-1c6bd494144a req-1aa7c096-9fcd-4204-a931-13bc4322cd21 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:00.626582 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-23991d27-8015-4fd6-97f2-1c6bd494144a req-1aa7c096-9fcd-4204-a931-13bc4322cd21 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:00.639286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-23991d27-8015-4fd6-97f2-1c6bd494144a req-1aa7c096-9fcd-4204-a931-13bc4322cd21 service nova] Creating event network-vif-plugged:d4613165-5d26-42a0-8ce9-00b3cd463123 for instance 75e124a5-544f-4269-a7a8-7092758233c2 on hv-cinder-85220 Sep 02 21:36:00.645311 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-23991d27-8015-4fd6-97f2-1c6bd494144a req-1aa7c096-9fcd-4204-a931-13bc4322cd21 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039141 Sep 02 21:36:00.648684 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 683/1321] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:36:01.321027 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:01.321633 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:01.323672 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=2 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:01.324303 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell0:SELECT=6 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:01.330102 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:01.331344 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:01.331803 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:01.332518 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:01.332974 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:01.333394 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:01.469085 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:36:01.477478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-b0e5baa8-9b9e-49e5-beef-b3de9f1a5bfc tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1367 microversion: 2.1 time: 0.160508 Sep 02 21:36:01.478082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 639/1322] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:36:01 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:36:02.498313 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell0:SELECT=6 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:02.503101 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:02.504748 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:02.510453 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:02.510853 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:02.511293 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:02.512003 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:02.512467 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:02.512897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:02.654682 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:36:02.662897 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-578f1740-7da0-48b1-8bf0-59fa3082252b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1367 microversion: 2.1 time: 0.165841 Sep 02 21:36:02.663470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 684/1323] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:36:02 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:36:03.685829 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:03.686895 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:03.693929 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:03.694890 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:03.694890 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:03.695586 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:03.696015 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:03.696444 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:03.843858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:36:03.853209 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-95f6d272-2bbc-4fb3-836c-42466065453e tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1558 microversion: 2.1 time: 0.171265 Sep 02 21:36:03.856471 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 640/1324] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:36:03 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:36:03.876782 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:03.877512 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:03.884373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:03.890767 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:03.890767 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:03.890767 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:03.890767 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:03.891414 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:03.969780 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-bcecb21f-fcfa-48fb-b280-ca29e31fe32f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097024 Sep 02 21:36:03.970416 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 685/1325] 10.222.0.79 () {58 vars in 1275 bytes} [Fri Sep 2 21:36:03 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:36:05.177781 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [req-a723c821-eddc-422d-84b2-e1f5e5396456 req-8a07c6db-5a95-492c-9904-a5479c25f598 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e124a5-544f-4269-a7a8-7092758233c2", "tag": "d4613165-5d26-42a0-8ce9-00b3cd463123"}]} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:36:05.190239 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-a723c821-eddc-422d-84b2-e1f5e5396456 req-8a07c6db-5a95-492c-9904-a5479c25f598 service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:05.191517 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-a723c821-eddc-422d-84b2-e1f5e5396456 req-8a07c6db-5a95-492c-9904-a5479c25f598 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:05.191969 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [req-a723c821-eddc-422d-84b2-e1f5e5396456 req-8a07c6db-5a95-492c-9904-a5479c25f598 service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:05.206118 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.compute.server_external_events [req-a723c821-eddc-422d-84b2-e1f5e5396456 req-8a07c6db-5a95-492c-9904-a5479c25f598 service nova] Creating event network-changed:d4613165-5d26-42a0-8ce9-00b3cd463123 for instance 75e124a5-544f-4269-a7a8-7092758233c2 on hv-cinder-85220 Sep 02 21:36:05.212093 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [req-a723c821-eddc-422d-84b2-e1f5e5396456 req-8a07c6db-5a95-492c-9904-a5479c25f598 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040078 Sep 02 21:36:05.213028 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 641/1326] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:36:41.546095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:41.546879 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG dbcounter [-] [121512] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:41.672895 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:41.673394 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:41.680018 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:41.680503 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:41.680931 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:41.681632 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:41.682108 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:41.682532 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:41.709625 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-350ef79b-abbf-454d-817d-369b5f8dfcd9 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/ips" status: 200 len: 150 microversion: 2.1 time: 0.165008 Sep 02 21:36:41.715095 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 686/1327] 10.222.0.79 () {58 vars in 1248 bytes} [Fri Sep 2 21:36:41 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/ips => generated 150 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:36:43.424753 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:43.427565 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG dbcounter [-] [121513] Writing DB stats nova_cell1:SELECT=84 {{(pid=121513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 02 21:36:43.430831 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27c18349-7a39-4223-976f-5bd48b94a907"}} {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:36:43.432986 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:43.440162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:43.440649 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:43.441092 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:43.441794 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:43.442312 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:43.442789 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:44.336953 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-18b2f97b-58d1-44f3-8855-221bf101d372 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "POST /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.915131 Sep 02 21:36:44.345874 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 642/1328] 10.222.0.79 () {60 vars in 1323 bytes} [Fri Sep 2 21:36:43 2022] POST /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 21:36:53.084018 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:53.084634 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:53.092109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:53.092602 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:53.093079 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:53.093793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:53.094279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:53.094964 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:53.185042 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.objects.instance [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lazy-loading 'services' on Instance uuid 75e124a5-544f-4269-a7a8-7092758233c2 {{(pid=121512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:36:53.433429 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-4cc4b701-99ba-4e9d-a08e-8acef4958bce tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments/27c18349-7a39-4223-976f-5bd48b94a907" status: 202 len: 0 microversion: 2.1 time: 0.353781 Sep 02 21:36:53.434204 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 687/1329] 10.222.0.79 () {58 vars in 1416 bytes} [Fri Sep 2 21:36:53 2022] DELETE /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments/27c18349-7a39-4223-976f-5bd48b94a907 => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 21:36:53.448913 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:53.452787 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:53.465802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:53.465802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:53.465802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:53.465802 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:53.466525 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:53.466525 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:53.496276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-fddc3f07-ccb9-48d6-bfa4-ad2d5dec67f8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056305 Sep 02 21:36:53.497272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 643/1330] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:36:53 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:36:54.511566 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:54.514297 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:54.521398 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:54.521910 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:54.522341 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:54.523040 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:54.523486 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:54.523906 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:54.557581 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-e8875c38-cbd3-4204-b3ba-93670f507a99 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050824 Sep 02 21:36:54.558183 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 688/1331] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:36:54 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:36:55.571138 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:55.573363 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:55.580674 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:55.581162 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:55.581604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:55.582383 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:55.582870 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:55.583270 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:55.613441 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-511deab7-a99d-4283-8840-bb773b21614b tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046348 Sep 02 21:36:55.614038 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 644/1332] 10.222.0.79 () {58 vars in 1302 bytes} [Fri Sep 2 21:36:55 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 21:36:55.679586 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:55.680149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:55.686710 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:55.687191 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:55.687631 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:55.688389 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:55.688851 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:55.689279 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:55.716643 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Going to try to terminate instance {{(pid=121512) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 02 21:36:56.319267 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-dbc1671e-2a70-4c80-b9b5-6f2fafcc7e05 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 204 len: 0 microversion: 2.1 time: 0.643261 Sep 02 21:36:56.319872 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 689/1333] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:36:55 2022] DELETE /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 21:36:56.332332 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:56.332949 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:56.339019 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:56.339489 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:56.339916 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:56.340607 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:56.341053 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:56.341476 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:56.494424 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:36:56.502399 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-05093b0f-c7dc-43e3-b1fc-a5f465670319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1682 microversion: 2.1 time: 0.175026 Sep 02 21:36:56.502964 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 645/1334] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:36:56 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 21:36:57.527373 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:57.528169 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:57.535858 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:57.536352 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:57.536793 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:57.537506 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:57.537990 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:57.538418 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:57.677904 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.policy [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121512) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:36:57.686367 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-125104ca-2eda-4e8e-aebd-c147e09417ab tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1682 microversion: 2.1 time: 0.163382 Sep 02 21:36:57.686959 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 690/1335] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:36:57 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:36:58.710768 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:58.719917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:58.719917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:58.719917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:58.720407 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:58.721219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:58.721858 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:58.722294 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:58.916639 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:36:58.924917 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-82d0c312-79d6-4eb2-b258-a24ddb0959d8 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1682 microversion: 2.1 time: 0.218044 Sep 02 21:36:58.925494 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 646/1336] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:36:58 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:36:59.210052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [req-5596fe17-e692-41b3-9908-92a2971451d8 req-f68dcf39-69ce-4c60-a70e-e91acd04b29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e124a5-544f-4269-a7a8-7092758233c2", "name": "network-vif-deleted", "tag": "d4613165-5d26-42a0-8ce9-00b3cd463123"}]} {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 21:36:59.222784 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5596fe17-e692-41b3-9908-92a2971451d8 req-f68dcf39-69ce-4c60-a70e-e91acd04b29c service nova] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:59.223262 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5596fe17-e692-41b3-9908-92a2971451d8 req-f68dcf39-69ce-4c60-a70e-e91acd04b29c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:59.223690 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [req-5596fe17-e692-41b3-9908-92a2971451d8 req-f68dcf39-69ce-4c60-a70e-e91acd04b29c service nova] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:59.237788 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.compute.server_external_events [req-5596fe17-e692-41b3-9908-92a2971451d8 req-f68dcf39-69ce-4c60-a70e-e91acd04b29c service nova] Creating event network-vif-deleted:d4613165-5d26-42a0-8ce9-00b3cd463123 for instance 75e124a5-544f-4269-a7a8-7092758233c2 on hv-cinder-85220 Sep 02 21:36:59.243090 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [req-5596fe17-e692-41b3-9908-92a2971451d8 req-f68dcf39-69ce-4c60-a70e-e91acd04b29c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036684 Sep 02 21:36:59.243934 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 691/1337] 10.222.0.79 () {64 vars in 1317 bytes} [Fri Sep 2 21:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 21:36:59.948604 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:36:59.949386 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:36:59.956642 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:59.957376 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:59.963262 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:59.963447 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:59.963985 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:36:59.964490 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:36:59.999462 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:36:59.999944 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:00.000389 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:00.001082 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.objects.instance [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lazy-loading 'fault' on Instance uuid 75e124a5-544f-4269-a7a8-7092758233c2 {{(pid=121513) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 02 21:37:00.049219 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.policy [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e343f998e5e34447bd2b5f0a2627bbdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0e4c1f5dfdb49abb0ca5ca324976acb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121513) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 21:37:00.057885 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-83b71627-a380-471f-b984-f3dcaccc3435 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 200 len: 1332 microversion: 2.1 time: 0.113048 Sep 02 21:37:00.058577 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 647/1338] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:36:59 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 21:37:01.083969 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:01.084672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:01.090986 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:01.091470 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:01.091905 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:01.092599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:01.093053 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:01.093482 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:01.108354 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 HTTP/1.1 Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:37:01.110891 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:01.112760 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '75e124a5-544f-4269-a7a8-7092758233c2'} Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:01.114201 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:01.116021 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:01.118032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:01.118032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-77bef9d4-cea6-4871-91f2-a1576b81d57a tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 404 len: 111 microversion: 2.1 time: 0.033934 Sep 02 21:37:01.118032 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 692/1339] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:01 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:01.124278 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-04a962eb-f99d-4c72-8915-e822d223c535 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '.version_select at 0x7fb00ccde040>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:01.223137 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-04a962eb-f99d-4c72-8915-e822d223c535 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538913154" status: 202 len: 0 microversion: 2.1 time: 0.105029 Sep 02 21:37:01.223719 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 648/1340] 10.222.0.79 () {58 vars in 1221 bytes} [Fri Sep 2 21:37:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1538913154 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 21:37:03.634455 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:03.635005 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:03.643285 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:03.643773 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:03.644202 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:03.644908 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:03.645350 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:03.645775 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:03.661835 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 HTTP/1.1 Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:37:03.663404 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.665258 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '75e124a5-544f-4269-a7a8-7092758233c2'} Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:03.670330 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.671658 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.673149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:03.673149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-7d1afaaa-3019-4d4c-93e8-e310bd5adf87 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 404 len: 111 microversion: 2.1 time: 0.034300 Sep 02 21:37:03.673149 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 693/1341] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:37:03 2022] DELETE /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:03.678051 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:03.678724 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 75e124a5-544f-4269-a7a8-7092758233c2] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:03.685670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:03.686233 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:03.686670 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:03.687371 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:03.688350 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:03.688813 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:03.703084 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 HTTP/1.1 Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:37:03.705909 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.707644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '75e124a5-544f-4269-a7a8-7092758233c2'} Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:03.708795 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. Sep 02 21:37:03.711997 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:03.713470 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 75e124a5-544f-4269-a7a8-7092758233c2 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:03.713470 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-38a180f4-3946-4d85-b380-c684dcc40319 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2" status: 404 len: 111 microversion: 2.1 time: 0.033737 Sep 02 21:37:03.713470 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 649/1342] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:03 2022] GET /compute/v2.1/servers/75e124a5-544f-4269-a7a8-7092758233c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:04.957677 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:04.964052 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:04.965005 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:04.965498 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:04.966010 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:04.966719 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:04.967173 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:04.967599 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:04.982304 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b HTTP/1.1 Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:37:04.983898 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:04.987357 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '32fb4544-d799-4ef2-b744-c4ce88356b0b'} Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:04.988308 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:04.989913 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:04.995901 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:04.995901 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-9aca386a-1a3a-4c96-910d-cbdd228a6777 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 404 len: 111 microversion: 2.1 time: 0.032170 Sep 02 21:37:04.995901 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 694/1343] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:37:04 2022] DELETE /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:05.001644 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:05.002368 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 32fb4544-d799-4ef2-b744-c4ce88356b0b] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:05.009033 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:05.009596 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:05.010126 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:05.010810 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:05.011269 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:05.011757 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:05.025912 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b HTTP/1.1 Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:37:05.027472 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:05.030018 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '32fb4544-d799-4ef2-b744-c4ce88356b0b'} Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:05.031478 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. Sep 02 21:37:05.034160 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.036990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 32fb4544-d799-4ef2-b744-c4ce88356b0b could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:05.036990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-9b09b075-9c31-4440-937c-c4df12aefce4 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b" status: 404 len: 111 microversion: 2.1 time: 0.031976 Sep 02 21:37:05.036990 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 650/1344] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:04 2022] GET /compute/v2.1/servers/32fb4544-d799-4ef2-b744-c4ce88356b0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:05.039584 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:05.040074 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:05.046545 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:05.047526 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:05.047954 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:05.048825 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:05.049272 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:05.049694 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:05.066745 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 HTTP/1.1 Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:37:05.068286 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.070109 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '2a250bcd-5a3f-468b-a31e-2c4f4c20f895'} Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:05.071148 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.072539 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.073979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:05.073979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-f019a2e9-e2eb-43bf-a549-78d5afcd4d3f tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 404 len: 111 microversion: 2.1 time: 0.035756 Sep 02 21:37:05.073979 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 695/1345] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:37:05 2022] DELETE /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:05.079210 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:05.079937 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 2a250bcd-5a3f-468b-a31e-2c4f4c20f895] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:05.086197 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:05.086683 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:05.087157 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:05.087864 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:05.088325 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:05.088751 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:05.104688 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 HTTP/1.1 Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:37:05.106306 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.109153 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '2a250bcd-5a3f-468b-a31e-2c4f4c20f895'} Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:05.110154 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. Sep 02 21:37:05.111861 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:05.113276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 2a250bcd-5a3f-468b-a31e-2c4f4c20f895 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:05.113276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-6fc3ee1c-0623-459d-a6bf-cf08cebb77b0 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895" status: 404 len: 111 microversion: 2.1 time: 0.033126 Sep 02 21:37:05.113276 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 651/1346] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:05 2022] GET /compute/v2.1/servers/2a250bcd-5a3f-468b-a31e-2c4f4c20f895 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:06.450780 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:06.451328 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.compute.api [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121512) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:06.458161 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:06.458722 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:06.459256 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:06.460030 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:06.460493 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:06.460918 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG oslo_concurrency.lockutils [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:06.475265 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.wsgi [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: request: DELETE /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 HTTP/1.1 Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept: application/json Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Accept-Encoding: identity Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Connection: close Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Length: 0 Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Content-Type: application/json Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Host: 10.222.0.79 Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: Openstack-System-Scope: None Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Id: None Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Domain-Name: None Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Identity-Status: Confirmed Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Is-Admin-Project: True Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Id: default Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Domain-Name: Default Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Role: reader,member Sep 02 21:37:06.476821 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Roles: reader,member Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Id: default Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Domain-Name: Default Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: method: > Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: exception: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.478672 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: action_args: {'id': '9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82'} Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: {{(pid=121512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:06.481084 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.482814 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.484434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: DEBUG nova.api.openstack.wsgi [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. {{(pid=121512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:06.484434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: INFO nova.api.openstack.requestlog [None req-5df6737f-4412-4bc7-a970-db9ee998c43d tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "DELETE /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 404 len: 111 microversion: 2.1 time: 0.031445 Sep 02 21:37:06.484434 dv-cinder-852209-11-iscsi devstack@n-api.service[121512]: [pid: 121512|app: 0|req: 696/1347] 10.222.0.79 () {58 vars in 1239 bytes} [Fri Sep 2 21:37:06 2022] DELETE /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 21:37:06.486879 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Calling method '>' {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 21:37:06.488064 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.compute.api [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] [instance: 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82] Fetching instance by UUID {{(pid=121513) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 02 21:37:06.494792 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:06.495272 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:06.495711 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:06.496449 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Acquiring lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 02 21:37:06.496907 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 02 21:37:06.497334 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG oslo_concurrency.lockutils [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Lock "65d0b9d2-8f86-4245-a4cb-5092df7bfecb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121513) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 02 21:37:06.513423 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.wsgi [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] HTTP exception thrown: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Request method failure captured: Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: request: GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 HTTP/1.1 Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept: application/json Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Accept-Encoding: identity Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Connection: close Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Length: 0 Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Content-Type: application/json Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Host: 10.222.0.79 Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: Openstack-System-Scope: None Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: User-Agent: python-urllib3/1.26.12 Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Auth-Token: gAAAAABjEnYtoT1Q7DWyGdEUKXTmqeOMgPvxdOa5oOqOR23qRE_ZaGeU3vI54N1_ptqARN_5GG2tburIx0-Jc3V4vA7MtnX2iA24psjdhb20qEGifXY1ywojQ_A3bK44LTcaK8P8pmDwqYOup2YDBNyBhEslXbu8Dr_kAxj3hG_kxNqBPrhNU2s Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Id: None Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Domain-Name: None Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Identity-Status: Confirmed Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Is-Admin-Project: True Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Id: default Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Domain-Name: Default Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Project-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Role: reader,member Sep 02 21:37:06.515012 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Roles: reader,member Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d0e4c1f5dfdb49abb0ca5ca324976acb"}]}] Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Id: d0e4c1f5dfdb49abb0ca5ca324976acb Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2023748660 Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Id: default Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Domain-Name: Default Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Id: e343f998e5e34447bd2b5f0a2627bbdf Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: X-User-Name: tempest-AttachVolumeNegativeTest-2023748660-project Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: method: > Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: exception: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.516748 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: action_args: {'id': '9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82'} Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: {{(pid=121513) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 02 21:37:06.517940 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. Sep 02 21:37:06.519590 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: ERROR nova.api.openstack.wsgi Sep 02 21:37:06.521050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: DEBUG nova.api.openstack.wsgi [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] Returning 404 to user: Instance 9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 could not be found. {{(pid=121513) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 02 21:37:06.521050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: INFO nova.api.openstack.requestlog [None req-cb28fce0-f6de-4816-9378-fd8fd03e1426 tempest-AttachVolumeNegativeTest-2023748660 tempest-AttachVolumeNegativeTest-2023748660-project] 10.222.0.79 "GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82" status: 404 len: 111 microversion: 2.1 time: 0.033402 Sep 02 21:37:06.521050 dv-cinder-852209-11-iscsi devstack@n-api.service[121513]: [pid: 121513|app: 0|req: 652/1348] 10.222.0.79 () {58 vars in 1236 bytes} [Fri Sep 2 21:37:06 2022] GET /compute/v2.1/servers/9f5a4cc4-b8b1-4310-8b5b-177a80dd3b82 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)